-- Logs begin at Wed 2022-08-24 07:03:20 UTC, end at Wed 2022-08-24 08:18:06 UTC. -- Aug 24 07:46:56.394914 dv-cinder-854275-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 07:46:56.408943 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 07:46:56.410942 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 07:46:56 2022] *** Aug 24 07:46:56.410942 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 07:46:56.410942 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 07:46:56.410942 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: nodename: dv-cinder-854275-1-iscsi Aug 24 07:46:56.410942 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: machine: x86_64 Aug 24 07:46:56.410942 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: clock source: unix Aug 24 07:46:56.410942 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: pcre jit disabled Aug 24 07:46:56.410942 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: detected number of CPU cores: 4 Aug 24 07:46:56.410942 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: current working directory: / Aug 24 07:46:56.410942 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: detected binary path: /usr/bin/uwsgi-core Aug 24 07:46:56.410942 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: your processes number limit is 47680 Aug 24 07:46:56.411704 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: your memory page size is 4096 bytes Aug 24 07:46:56.411704 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: detected max file descriptor number: 2048 Aug 24 07:46:56.411704 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: lock engine: pthread robust mutexes Aug 24 07:46:56.411704 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: thunder lock: enabled Aug 24 07:46:56.411704 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 07:46:56.411704 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 07:46:56.450457 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: Python main interpreter initialized at 0x55a6769c19c0 Aug 24 07:46:56.450457 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: python threads support enabled Aug 24 07:46:56.450457 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: your server socket listen backlog is limited to 100 connections Aug 24 07:46:56.450457 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: your mercy for graceful operations on workers is 90 seconds Aug 24 07:46:56.450811 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 07:46:56.450886 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: *** Operational MODE: preforking *** Aug 24 07:46:56.451119 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: *** uWSGI is running in multiple interpreter mode *** Aug 24 07:46:56.451119 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: spawned uWSGI master process (pid: 112562) Aug 24 07:46:56.451316 dv-cinder-854275-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 07:46:56.455114 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: spawned uWSGI worker 1 (pid: 112563, cores: 1) Aug 24 07:46:56.455114 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: spawned uWSGI worker 2 (pid: 112564, cores: 1) Aug 24 07:46:56.455114 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 07:46:57.121994 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 07:46:57.132962 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 07:46:58.219253 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:46:58.219253 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: from cryptography.utils import int_from_bytes Aug 24 07:46:58.219955 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:46:58.219955 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: from cryptography.utils import int_from_bytes Aug 24 07:46:58.220336 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:46:58.220336 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: from cryptography.utils import int_from_bytes Aug 24 07:46:58.220449 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:46:58.220449 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: from cryptography.utils import int_from_bytes Aug 24 07:47:00.679623 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 07:47:00.680259 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 07:47:00.680358 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 07:47:00.680629 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 07:47:00.680902 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 07:47:00.681285 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.681604 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.681918 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.682228 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.682552 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.682857 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.683170 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.683480 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.683802 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.684003 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 07:47:00.684370 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.684461 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 07:47:00.684537 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.684674 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854275-1-iscsi {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.684892 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 07:47:00.685052 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.685218 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 07:47:00.685379 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.685541 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 07:47:00.685713 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.685863 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.686023 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.686189 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.686338 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.686484 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.686634 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.686778 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.686935 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.687079 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.687232 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.687412 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.687634 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.687745 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.688864 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.688980 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.689052 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.689127 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.689201 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.689349 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.689420 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.689493 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.689559 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854275-1-iscsi {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.689624 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.689696 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.689777 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.689854 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.689929 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.690088 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.690213 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.690390 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.690538 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.690700 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.690898 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854275-1-iscsi {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.691025 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.691212 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.691351 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.691520 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.692367 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.692537 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.692719 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.692862 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.692988 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.693106 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.693295 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.693420 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.693634 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.693774 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.693948 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.694071 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.694258 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.694396 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.694578 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.694705 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.694886 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.695027 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.695196 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.695315 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.695503 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.695628 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.695798 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.695952 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854275-1-iscsi {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.696171 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.696393 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.696582 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.696719 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.696931 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.697023 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.697234 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.697357 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.697536 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.697668 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.697764 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.697985 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.698072 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.698307 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.698416 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.698631 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.698717 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.698939 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.699025 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.699207 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.699303 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.699450 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.699584 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.699760 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.699901 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.700072 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.700223 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.700400 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.700535 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.700721 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.700951 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.701055 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.701264 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.701351 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.701586 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.701684 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.701880 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.701977 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.702176 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.702267 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.702438 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.702535 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.702727 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.702876 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.703050 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.703145 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.703358 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.703444 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.703656 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.703750 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.703916 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.704027 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.704161 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.704341 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.704469 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.704584 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.704818 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.704919 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.705129 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.705228 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.705436 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.705523 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.705742 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.705829 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.706056 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.706206 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.706343 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.706427 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.706643 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.706740 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.706948 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.707045 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.707247 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.707355 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.707586 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.707679 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.707907 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.708007 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.708201 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.708287 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.708445 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.708539 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.708762 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.708851 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.709062 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.709237 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.709374 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.709489 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.709672 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.709797 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.709969 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.710138 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.710264 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.710457 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.710552 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.710766 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.710851 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.711085 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.711171 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.711402 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.711498 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.711697 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.711790 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.711992 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.712085 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.712286 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.712380 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.712583 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.712721 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.712902 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.712994 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.713198 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.713286 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.713479 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.713566 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.713782 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.713868 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.714085 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.714171 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.714379 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.714467 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.714674 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.714846 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.714971 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.715066 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.715274 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.715369 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.715566 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.715658 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.715862 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.715949 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.716163 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.716294 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.716457 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.716552 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.716772 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.716863 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.717076 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.717163 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.717378 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.717471 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.717672 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.717758 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.717983 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.718074 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.718273 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.718366 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.718571 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.718656 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.718971 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.719069 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.719548 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.719650 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.719732 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.719811 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.719901 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.719996 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.720086 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.720175 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.720375 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.720462 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.720701 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.720791 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.720985 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.721089 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.721279 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.721365 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.721572 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.721659 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.721877 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.721977 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.722185 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.722270 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.722485 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.722571 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.722783 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.722886 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.723090 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.723175 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.723402 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.723502 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.723733 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.723833 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.724049 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.724134 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.724355 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.724442 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.724668 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.724757 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.724984 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.725069 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.725291 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.725376 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.725595 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.725683 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.725899 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.725986 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.726202 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.726297 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.726509 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.726607 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.726808 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.726903 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.727112 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.727205 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.727422 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.727515 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.727733 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.727816 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.728038 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.728132 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.728343 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.728430 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.728671 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.728758 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:47:00.728984 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.729082 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.729295 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.729381 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.729596 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.729682 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.729904 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.729992 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.730226 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.730311 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.730541 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.730626 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.730845 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.730944 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.731178 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.731265 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.731515 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.731602 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.731818 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.731913 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.732143 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.732228 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.732459 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.732546 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.732806 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.732896 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.733130 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.733218 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.733433 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.733532 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.733753 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.733840 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.734074 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.734157 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.734376 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.734456 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.734692 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.734780 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.735000 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.735084 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.735302 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.735466 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.735608 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.735701 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.735912 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.735997 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.736216 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.736309 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.736553 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.736699 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.736887 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.736983 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.737199 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.737303 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.737512 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.737603 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.737827 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.737926 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.738133 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.738234 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.738438 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.739031 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.739277 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.739375 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.739578 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.739677 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.739882 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.739973 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.740183 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.740274 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.740489 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.740581 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.740813 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.740905 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.741129 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.741220 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.741451 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.741549 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.741754 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.741844 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.742064 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.742160 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.742371 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.742461 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.742677 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.742776 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.743011 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.743130 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.743326 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.743417 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.743648 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.743738 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.743952 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.744072 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.744263 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.744371 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.744561 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.744679 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.744894 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.744994 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.745204 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.745383 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.745514 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.745819 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.745906 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.746122 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.746208 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.746436 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.746529 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.746744 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.746843 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.747055 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.747142 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.747363 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.747455 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.747670 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.747764 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.747983 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.748069 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.748289 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.748374 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.748602 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.748732 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.748935 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.749021 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.749243 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.749328 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.749553 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.749651 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.749863 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.749949 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.750169 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.750262 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.750488 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.750582 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.750797 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.750882 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.751104 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.751188 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.751404 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.751499 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.751706 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.751793 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.752005 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.752099 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.752304 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.752392 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.752605 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.752749 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.752933 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.753032 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.753235 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.753334 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.753532 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.753619 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.753831 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.753924 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.754127 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.754285 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.755058 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.755157 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.755379 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.755476 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.755687 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.755782 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.755988 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.756075 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.756289 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.756385 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.756586 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.756703 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.756954 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.757052 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.757254 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.757351 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.757568 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.757653 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.757878 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.757963 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.758192 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.758293 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.758505 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.758590 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.758812 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.758904 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.759115 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.759236 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.759419 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.759504 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.759725 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.759818 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.760028 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.760113 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.760335 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.760427 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.760665 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.760753 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.760976 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.761071 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.761282 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.761411 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.761585 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.761669 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.761906 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.762006 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.762214 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.762299 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.762529 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.762627 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.762831 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.762927 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.763142 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.763226 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.763481 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.763587 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.763813 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.763900 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.764106 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.764199 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.764417 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.764511 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.764741 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.764843 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.765054 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.765141 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.765359 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.765525 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.765666 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.765760 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.765973 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.766065 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.766276 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.766369 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.766587 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.766672 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.766891 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.766991 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.767202 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.767289 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.767503 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.767588 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.767811 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.767903 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.768116 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.768202 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.768427 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.768513 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.768748 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.768849 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.769059 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.769146 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.769377 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.769462 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.769703 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.769807 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.770034 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.770121 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.770341 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.770426 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.770651 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.770757 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.770953 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.771041 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.771260 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.771345 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.771564 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.771665 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.771864 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.771951 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.772164 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.772249 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.772468 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.772562 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.772804 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.772906 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.773108 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.773194 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.773410 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.773518 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.773708 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.773802 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.774014 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.774107 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.774318 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.774405 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.774615 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.774701 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.774910 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.774996 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.775213 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.775307 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.775528 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.775614 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.775832 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.775916 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.776146 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.776244 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.776454 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.776545 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.776778 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.776882 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.777084 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.777196 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.777394 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.777499 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.777693 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.777778 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.777995 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.778083 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.778293 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.778379 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.778589 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.778683 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.778899 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.778984 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.779211 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.779296 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.779505 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.779604 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.779807 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.779900 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.780117 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.780203 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.780417 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.780563 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.780746 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.780836 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.781052 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.781138 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.781452 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.781561 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.781690 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.781776 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.781997 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.782083 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.782324 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.782420 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.782636 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.782735 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.782942 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.783029 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.783246 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.783343 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.783548 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.783681 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.783863 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.783947 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.784167 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.784257 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.784470 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.784556 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.784796 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.784900 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.785099 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.785187 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.785415 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.785504 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.785735 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.785830 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.786044 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.786302 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.786389 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.786627 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.786714 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.786935 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.787023 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.787254 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.787362 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.787559 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.787651 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.787874 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.787968 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.788184 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.788270 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.788494 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.788580 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.788843 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.788932 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.789142 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.789238 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.789447 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.789534 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.789747 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.789846 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.790047 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.790132 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.790349 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.790436 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.790648 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.790736 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.790946 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.791217 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.791311 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.791534 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.791702 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.791832 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.791919 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.792129 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.792216 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.792425 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.792524 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.792752 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.792856 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.793053 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.793139 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.793352 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.793450 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.793657 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.793739 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.793956 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.794052 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.794272 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.794357 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.794573 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.794661 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.794869 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.794962 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.795165 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.795252 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.795462 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.795553 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.795777 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.795862 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.796084 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.796181 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.796394 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.796482 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.796722 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.796824 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.797030 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.797127 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.797346 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.797454 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.797638 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.797763 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.797958 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.798058 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.798265 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.798351 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.798577 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.798664 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.798883 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.798977 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.799187 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.799281 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.799489 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.799576 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.799788 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.799876 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.800088 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.800180 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.800388 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.800481 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.800712 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.800817 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.801033 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.801618 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.801836 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.801977 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.802140 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.802314 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.802440 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.802663 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.802759 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.803037 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.803123 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.803335 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.803632 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.803934 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.804486 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.804696 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.804808 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.805112 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.805410 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.805720 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.806019 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.806316 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.806484 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.806613 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.806837 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.806922 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.807200 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.807500 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.807818 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.808130 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.808285 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.808422 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.808572 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.808764 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.808908 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.809051 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.809209 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.809351 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.809518 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.809675 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.809820 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.809976 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.810138 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.810282 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.810449 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.810608 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.810748 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.810898 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.811044 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.811189 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.811348 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.811491 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.811637 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.811793 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.811940 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.812085 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.812249 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.812401 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.812564 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.812819 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.812970 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.813145 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.813301 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.813450 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.813591 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.813739 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.813880 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.814039 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.814187 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.814328 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.814479 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.814627 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.814772 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.814937 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.815095 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.815255 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.815513 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.815660 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.815806 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.815968 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.816119 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.816265 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.816411 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.816557 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.817280 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.817434 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.817678 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.817848 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.818054 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.818205 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.818367 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.818517 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.818684 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.818833 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.818980 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.819140 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.819300 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.819449 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.819608 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.819756 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.819900 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.820050 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.820216 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.820364 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.820509 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.820702 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.820852 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.821133 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.821282 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.821436 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.821581 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.821739 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.821845 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.821936 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.822026 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.822106 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.822185 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.822288 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.822446 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.822618 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.822770 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.822865 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.822945 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.823023 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.823101 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.823190 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.823271 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.823393 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.823568 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.823703 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.823879 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.824017 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.824186 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.824327 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.824495 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.824635 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.824826 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.824964 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.825135 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.825314 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.825441 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.825622 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.825743 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.825984 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.826071 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.826296 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.826381 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.826614 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.826709 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.826931 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.827018 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.827238 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.827323 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.827538 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.827670 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.827848 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.827938 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.828151 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.828236 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.828473 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.828561 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.828814 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.828905 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.829134 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.829234 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.829443 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.829531 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.829750 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.829844 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.830077 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.830163 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.830392 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.830479 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.830697 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.830781 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.831005 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.831104 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.831313 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.831399 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.831615 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.831700 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.831940 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.832033 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.832260 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.832366 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.832595 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.832695 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.832935 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.833033 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.833234 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.833328 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.833535 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.833627 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.833838 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.833933 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.834150 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.834234 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.834445 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.834529 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.834746 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.834834 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.835046 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.835131 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.835359 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.835445 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.835655 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.835781 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.835969 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.836053 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.836276 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.836361 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.836604 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.836753 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.836944 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.837033 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.837252 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.837367 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.837562 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.837673 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.837868 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.837983 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.838181 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.838299 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.838490 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.838616 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.838922 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.839008 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.839218 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.839311 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.839525 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.839611 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.839827 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.839912 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.840135 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.840233 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.840448 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.840533 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.840769 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.840869 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.841079 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.841173 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.841379 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.841465 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.841694 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.841781 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.842053 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.842139 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.842396 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.842488 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.842707 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.842794 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.843015 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.843114 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.843322 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.843409 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.843634 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.843719 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.843962 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.844049 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.844270 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.844366 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.844578 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.844710 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.844915 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.845001 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.845243 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.845340 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.845550 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.845636 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.845853 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.845945 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.846173 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.846283 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.846473 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.846595 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.846778 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.846904 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.847083 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.847324 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.847419 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.847639 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.847725 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.847992 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.848313 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.848614 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.848957 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.849268 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.849585 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.849903 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.850205 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.850524 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.850829 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.850998 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.851130 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.851384 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.851473 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.851716 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.851801 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.852112 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.852420 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.852545 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.852770 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.853041 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.853128 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.853412 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.853502 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.853721 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.853804 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.854049 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.854125 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.854429 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.854513 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.854743 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.854874 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.855057 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.855378 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.855490 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.855681 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.855981 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.856067 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.856284 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.856585 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.856702 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.856909 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.857209 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.857294 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.857569 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.857657 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.857868 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.857979 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.858170 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.858423 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.858519 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.858817 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.858911 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.859120 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.859437 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.859524 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.859739 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.859824 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.860037 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.860125 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.860338 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.860425 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.860634 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.860799 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.860993 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.861081 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.861349 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.861649 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.861744 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.861961 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.862227 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.862314 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.862577 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.862799 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.862931 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.863182 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.863333 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.864083 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.864203 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.864533 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.864628 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.864888 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.865047 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.865168 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.865251 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.865457 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.865565 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.865769 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.865857 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.866082 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.866168 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.866396 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.866492 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.866749 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.866987 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.867073 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.867315 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.867401 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.867624 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.867713 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.867932 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.868026 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.868240 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.868326 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.868555 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.868643 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.868888 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.868977 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.869193 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.869289 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.869498 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.869585 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.869801 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.869888 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.870107 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.870202 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.870429 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.870516 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.870746 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.870840 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.871065 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.871231 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.871394 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.871490 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.871709 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.871805 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.872020 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.872118 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.872330 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.872417 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.872639 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.872778 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.873012 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.873114 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.873320 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.873406 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.873619 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.873713 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.873928 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.874016 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.874234 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.874329 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.874540 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.874635 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.874847 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.874933 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.875153 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.875238 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.875460 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.875555 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.875767 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.875853 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.876070 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.876156 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.876376 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.876473 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.876706 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.876798 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.877018 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.877106 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.877322 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.877417 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.877633 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.877719 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.877939 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.878034 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.878244 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.878340 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.878559 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.878702 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.878871 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.878958 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.879247 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.880077 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.880240 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.880349 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.880464 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.880637 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.880804 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.880979 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.881095 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.881302 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.881389 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.881617 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.881705 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.881929 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.882025 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.882244 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.882330 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.882544 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.882632 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.882845 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.882933 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.883151 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.883246 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.883454 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.883549 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.883753 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.884015 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.884102 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.884350 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.884451 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.884658 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.884747 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.884978 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.885065 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.885284 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.885373 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.885602 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.885810 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.885918 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.886154 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.886249 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.886467 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.886561 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.886790 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.886877 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.887112 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.887207 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.887427 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.887513 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.887731 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.887817 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.888050 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.888139 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.888351 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.888436 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.888672 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.888823 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.888988 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.889077 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.889292 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.889378 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.889593 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.889681 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.889894 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.889983 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.890198 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.890285 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.890502 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.890597 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.890803 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.890899 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.891106 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.891192 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.891402 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.891496 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.891720 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.891806 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.892023 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.892111 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.892323 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.892418 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.892621 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.892774 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.892947 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.893037 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.893246 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.893334 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.893544 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.893632 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.893875 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.893960 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.894203 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.894298 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.894508 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.894602 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.894836 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.894926 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.895175 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.895263 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.895494 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.895580 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.895819 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.895905 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.896119 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.896347 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.896479 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.896698 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.896791 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.897024 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.897113 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.897321 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.897406 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.897668 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.897754 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.897978 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.898064 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.898283 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.898379 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.898607 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.898694 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.898911 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.899005 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.899211 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.899297 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.899521 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.899606 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.899832 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.899920 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.900138 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.900388 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.900476 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.900744 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.900847 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.901064 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.901152 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.901381 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.901467 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.901694 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.901789 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.901995 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.902234 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.902321 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.902585 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.902685 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.902902 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.902988 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.903210 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.903337 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.903517 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.903613 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.903821 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.903907 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.904126 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.904215 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.904430 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.904518 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.904754 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.904856 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.905065 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.905150 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.905368 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.905463 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.905672 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.905759 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.905975 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.906061 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.906279 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.906366 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.906577 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.906663 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.906880 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.906982 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.907184 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.907270 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.907484 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.907576 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.907785 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.907946 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.908113 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.908200 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.908421 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.908506 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.908751 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.908856 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.909061 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.909151 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.909364 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.909449 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.909666 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.909761 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.909969 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.910056 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.910271 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.910356 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.911104 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.911193 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.911417 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.911503 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.911723 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.911809 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.912022 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.912109 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.912324 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.912437 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.912635 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.912768 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.912965 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.913083 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.913277 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.913406 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.913583 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.913679 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.913909 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.913996 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.914213 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.914299 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.914567 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.914668 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.914886 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.914973 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.915188 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.915275 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.915509 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.915604 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.915823 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.915911 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.916141 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.916227 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.916459 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.916553 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.916786 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.916889 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.917092 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.917345 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.917440 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.917685 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.917778 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.917999 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.918094 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.918304 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.918400 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.918604 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.918690 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.918903 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.918989 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.919215 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.919310 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.919514 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.919600 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.919811 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.919897 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.920109 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.920199 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.920408 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.920494 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.920729 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.920818 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.921029 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.921118 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.921328 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.921422 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.921627 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.921715 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.921975 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.922064 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.922283 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.922368 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.922585 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.922677 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.922891 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.922986 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.923188 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.923313 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.923498 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.923642 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.923781 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.923875 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.924078 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.924164 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.924376 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.924473 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.924730 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.924849 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.925056 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.925171 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.925363 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.925473 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.925680 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.925766 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.925982 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.926108 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.926850 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.926940 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.927158 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.927244 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.927469 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.927554 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.927785 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.927881 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.928095 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.928180 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.928401 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.928489 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.928748 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.928840 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.929311 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.929409 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.929618 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.929783 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.929926 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.930052 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.930233 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.930372 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.930538 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.930696 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.930846 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.931011 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.931168 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.931337 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.931490 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.931664 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.931794 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.931978 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.932114 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.932301 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.932446 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.932614 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.932844 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.932974 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.933159 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.933318 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.933454 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.933651 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.933794 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.933985 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.934073 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.934298 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.934398 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.934611 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.934697 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.934921 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.935008 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.935246 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.935427 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.935565 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.935709 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.935851 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.935985 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.936137 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.936277 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.936438 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.936544 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.936764 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.936847 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.937072 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.937162 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.937382 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.937468 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.937689 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.937777 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.937995 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.938085 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.938305 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.938400 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.938612 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.938699 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.938918 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.939006 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.939224 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.939310 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.939532 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.939627 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.939839 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.939934 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.940144 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.940241 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.940447 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.940543 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.940704 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 07:47:00.940796 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.941066 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.941370 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.941699 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.942005 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.942342 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.942677 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.942994 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.943323 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.943635 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.943965 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.944276 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.944601 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.944951 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.945273 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.945585 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.945926 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.946241 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.946557 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.946872 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.947186 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.947544 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.947814 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.948147 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.948477 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.948813 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.949188 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.949552 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.949790 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.950107 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.950420 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.950755 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.951069 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.951381 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.951692 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.952003 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.952314 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.952630 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.952977 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.953290 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.953604 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.953926 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.954260 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.954591 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.954902 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.955232 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.955561 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.955919 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.956234 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.956580 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.956940 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.957259 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.957596 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.957906 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:47:00.958149 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 07:47:01.092941 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO dbcounter [None req-8350a014-fbce-43fb-b099-48ce204a9b22 None None] Registered counter for database nova_api Aug 24 07:47:01.110233 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO dbcounter [None req-1496a130-e453-4558-9319-0a2d02c9de27 None None] Registered counter for database nova_api Aug 24 07:47:01.114353 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_db.sqlalchemy.engines [None req-8350a014-fbce-43fb-b099-48ce204a9b22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:47:01.120796 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG dbcounter [-] [112563] Writer thread running {{(pid=112563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:47:01.130717 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG oslo_db.sqlalchemy.engines [None req-1496a130-e453-4558-9319-0a2d02c9de27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:47:01.138022 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG dbcounter [-] [112564] Writer thread running {{(pid=112564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:47:01.181592 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.context [None req-8350a014-fbce-43fb-b099-48ce204a9b22 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bfac71ef-5ab0-4896-a5e4-5bd5fe410926(cell1) {{(pid=112563) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 07:47:01.185380 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-8350a014-fbce-43fb-b099-48ce204a9b22 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:01.185852 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-8350a014-fbce-43fb-b099-48ce204a9b22 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:01.187394 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-8350a014-fbce-43fb-b099-48ce204a9b22 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:01.188110 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-8350a014-fbce-43fb-b099-48ce204a9b22 None None] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:01.188539 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-8350a014-fbce-43fb-b099-48ce204a9b22 None None] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:01.190533 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-8350a014-fbce-43fb-b099-48ce204a9b22 None None] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:01.192507 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO dbcounter [None req-8350a014-fbce-43fb-b099-48ce204a9b22 None None] Registered counter for database nova_cell0 Aug 24 07:47:01.197886 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO dbcounter [None req-8350a014-fbce-43fb-b099-48ce204a9b22 None None] Registered counter for database nova_cell1 Aug 24 07:47:01.205636 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_db.sqlalchemy.engines [None req-8350a014-fbce-43fb-b099-48ce204a9b22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:47:01.206625 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.context [None req-1496a130-e453-4558-9319-0a2d02c9de27 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bfac71ef-5ab0-4896-a5e4-5bd5fe410926(cell1) {{(pid=112564) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 07:47:01.207921 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_db.sqlalchemy.engines [None req-8350a014-fbce-43fb-b099-48ce204a9b22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:47:01.210561 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG oslo_concurrency.lockutils [None req-1496a130-e453-4558-9319-0a2d02c9de27 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:01.211034 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG oslo_concurrency.lockutils [None req-1496a130-e453-4558-9319-0a2d02c9de27 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:01.212595 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG oslo_concurrency.lockutils [None req-1496a130-e453-4558-9319-0a2d02c9de27 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:01.213350 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG oslo_concurrency.lockutils [None req-1496a130-e453-4558-9319-0a2d02c9de27 None None] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:01.213643 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG dbcounter [-] [112563] Writer thread running {{(pid=112563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:47:01.213785 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG oslo_concurrency.lockutils [None req-1496a130-e453-4558-9319-0a2d02c9de27 None None] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:01.215782 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG oslo_concurrency.lockutils [None req-1496a130-e453-4558-9319-0a2d02c9de27 None None] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:01.215956 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG dbcounter [-] [112563] Writer thread running {{(pid=112563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:47:01.217786 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO dbcounter [None req-1496a130-e453-4558-9319-0a2d02c9de27 None None] Registered counter for database nova_cell0 Aug 24 07:47:01.223766 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO dbcounter [None req-1496a130-e453-4558-9319-0a2d02c9de27 None None] Registered counter for database nova_cell1 Aug 24 07:47:01.230864 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG oslo_db.sqlalchemy.engines [None req-1496a130-e453-4558-9319-0a2d02c9de27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:47:01.233039 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG oslo_db.sqlalchemy.engines [None req-1496a130-e453-4558-9319-0a2d02c9de27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:47:01.239470 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG dbcounter [-] [112564] Writer thread running {{(pid=112564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:47:01.240910 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG dbcounter [-] [112564] Writer thread running {{(pid=112564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:47:01.363330 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO dbcounter [None req-8350a014-fbce-43fb-b099-48ce204a9b22 None None] Registered counter for database nova_cell0 Aug 24 07:47:01.370350 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_db.sqlalchemy.engines [None req-8350a014-fbce-43fb-b099-48ce204a9b22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:47:01.374612 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG dbcounter [-] [112563] Writer thread running {{(pid=112563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:47:01.383894 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO dbcounter [None req-1496a130-e453-4558-9319-0a2d02c9de27 None None] Registered counter for database nova_cell0 Aug 24 07:47:01.392898 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG oslo_db.sqlalchemy.engines [None req-1496a130-e453-4558-9319-0a2d02c9de27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:47:01.398136 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG dbcounter [-] [112564] Writer thread running {{(pid=112564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:47:01.796421 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: WARNING keystonemiddleware.auth_token [None req-8350a014-fbce-43fb-b099-48ce204a9b22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 07:47:01.803703 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: WARNING keystonemiddleware.auth_token [None req-8350a014-fbce-43fb-b099-48ce204a9b22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 07:47:01.828781 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: WARNING keystonemiddleware.auth_token [None req-1496a130-e453-4558-9319-0a2d02c9de27 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 07:47:01.836637 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: WARNING keystonemiddleware.auth_token [None req-1496a130-e453-4558-9319-0a2d02c9de27 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 07:47:02.146121 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: WARNING keystonemiddleware.auth_token [None req-8350a014-fbce-43fb-b099-48ce204a9b22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 07:47:02.152102 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: WARNING keystonemiddleware.auth_token [None req-8350a014-fbce-43fb-b099-48ce204a9b22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 07:47:02.157371 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a6769c19c0 pid: 112563 (default app) Aug 24 07:47:02.159442 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-8350a014-fbce-43fb-b099-48ce204a9b22 None None] Calling method '>' {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:02.160638 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-8350a014-fbce-43fb-b099-48ce204a9b22 None None] 10.222.0.72 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001719 Aug 24 07:47:02.161079 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 1/1] 10.222.0.72 () {50 vars in 788 bytes} [Wed Aug 24 07:47:02 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:47:02.179946 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: WARNING keystonemiddleware.auth_token [None req-1496a130-e453-4558-9319-0a2d02c9de27 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 07:47:02.185885 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: WARNING keystonemiddleware.auth_token [None req-1496a130-e453-4558-9319-0a2d02c9de27 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 07:47:02.191099 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a6769c19c0 pid: 112564 (default app) Aug 24 07:48:23.806103 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-8350a014-fbce-43fb-b099-48ce204a9b22 None None] Calling method '>' {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:23.807104 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-8350a014-fbce-43fb-b099-48ce204a9b22 None None] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 24 07:48:23.807521 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 2/2] 10.222.0.72 () {54 vars in 931 bytes} [Wed Aug 24 07:48:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:48:23.824228 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG dbcounter [-] [112564] Writing DB stats nova_api:SELECT=3 {{(pid=112564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:23.825400 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG dbcounter [-] [112564] Writing DB stats nova_cell0:SELECT=3 {{(pid=112564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:23.826256 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG dbcounter [-] [112564] Writing DB stats nova_cell1:SELECT=3 {{(pid=112564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:23.827557 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG dbcounter [-] [112564] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:24.692730 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-e89a53ac-4304-4636-a4df-6f1c19e6b5f5 admin admin] Calling method '>' {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:24.724089 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-e89a53ac-4304-4636-a4df-6f1c19e6b5f5 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.909487 Aug 24 07:48:24.724865 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 1/3] 10.222.0.72 () {60 vars in 1292 bytes} [Wed Aug 24 07:48:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:48:27.094959 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-8350a014-fbce-43fb-b099-48ce204a9b22 None None] Calling method '>' {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:27.095946 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-8350a014-fbce-43fb-b099-48ce204a9b22 None None] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Aug 24 07:48:27.096354 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 3/4] 10.222.0.72 () {54 vars in 931 bytes} [Wed Aug 24 07:48:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:48:27.574506 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-b3728c71-cce0-4512-9fda-933bd37825c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "vcpus": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "cirros256"}} {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:27.596404 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:48:27.596404 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: warnings.warn(msg) Aug 24 07:48:27.715033 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-b3728c71-cce0-4512-9fda-933bd37825c6 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.604209 Aug 24 07:48:27.715033 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 2/5] 10.222.0.72 () {64 vars in 1283 bytes} [Wed Aug 24 07:48:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:48:27.965002 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-5848236a-90b8-4e8d-bb56-bafdd4b1e8ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:27.968767 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:48:27.968767 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: warnings.warn(msg) Aug 24 07:48:27.971642 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG dbcounter [-] [112563] Writing DB stats nova_api:SELECT=3 {{(pid=112563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:27.972780 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG dbcounter [-] [112563] Writing DB stats nova_cell1:SELECT=3 {{(pid=112563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:27.973780 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG dbcounter [-] [112563] Writing DB stats nova_cell0:SELECT=3 {{(pid=112563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:27.974786 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG dbcounter [-] [112563] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:28.132168 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-5848236a-90b8-4e8d-bb56-bafdd4b1e8ac admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.413809 Aug 24 07:48:28.133834 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 4/6] 10.222.0.72 () {64 vars in 1336 bytes} [Wed Aug 24 07:48:27 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:48:30.515614 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-b3728c71-cce0-4512-9fda-933bd37825c6 admin admin] Calling method '>' {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:30.516621 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-b3728c71-cce0-4512-9fda-933bd37825c6 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 24 07:48:30.517234 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 3/7] 10.222.0.72 () {54 vars in 931 bytes} [Wed Aug 24 07:48:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:48:31.169339 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-f4e8b5e4-a7ef-4325-b0ff-85eeb9357e04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "swap": 0, "disk": 5, "ram": 512, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:31.188260 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:48:31.188260 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: warnings.warn(msg) Aug 24 07:48:31.290115 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-f4e8b5e4-a7ef-4325-b0ff-85eeb9357e04 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.765978 Aug 24 07:48:31.290860 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 5/8] 10.222.0.72 () {64 vars in 1283 bytes} [Wed Aug 24 07:48:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:48:31.302565 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-8afb96a1-cf89-4f52-8829-5dbbff3284f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:31.305748 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:48:31.305748 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: warnings.warn(msg) Aug 24 07:48:31.431171 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-8afb96a1-cf89-4f52-8829-5dbbff3284f2 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.132313 Aug 24 07:48:31.432145 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 4/9] 10.222.0.72 () {64 vars in 1336 bytes} [Wed Aug 24 07:48:31 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:48:33.792280 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-f4e8b5e4-a7ef-4325-b0ff-85eeb9357e04 admin admin] Calling method '>' {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:33.793325 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-f4e8b5e4-a7ef-4325-b0ff-85eeb9357e04 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 24 07:48:33.793727 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 6/10] 10.222.0.72 () {54 vars in 931 bytes} [Wed Aug 24 07:48:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:48:34.193543 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-3dc00684-910c-43d4-9cab-a80d64e2b69f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "d2", "name": "ds1G", "swap": 0, "ram": 1024}} {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:34.266837 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-3dc00684-910c-43d4-9cab-a80d64e2b69f admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.467068 Aug 24 07:48:34.267326 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 5/11] 10.222.0.72 () {64 vars in 1283 bytes} [Wed Aug 24 07:48:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 07:48:34.279984 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-be129f1a-d62d-4d72-879c-8628ffb37503 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:34.372308 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-be129f1a-d62d-4d72-879c-8628ffb37503 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095918 Aug 24 07:48:34.373114 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 7/12] 10.222.0.72 () {64 vars in 1336 bytes} [Wed Aug 24 07:48:34 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:48:36.751021 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-3dc00684-910c-43d4-9cab-a80d64e2b69f admin admin] Calling method '>' {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:36.752223 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-3dc00684-910c-43d4-9cab-a80d64e2b69f admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001598 Aug 24 07:48:36.753009 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 6/13] 10.222.0.72 () {54 vars in 931 bytes} [Wed Aug 24 07:48:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:48:37.220277 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-3dde34a7-aeb2-438c-9eef-8510a4e2fc6b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "swap": 0, "ram": 2048, "disk": 10, "vcpus": 2, "id": "d3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:37.289789 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-3dde34a7-aeb2-438c-9eef-8510a4e2fc6b admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.529366 Aug 24 07:48:37.290669 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 8/14] 10.222.0.72 () {64 vars in 1283 bytes} [Wed Aug 24 07:48:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:48:37.303557 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-1186a096-24a9-4507-9540-a5bab604f286 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:37.387868 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-1186a096-24a9-4507-9540-a5bab604f286 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088754 Aug 24 07:48:37.388825 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 7/15] 10.222.0.72 () {64 vars in 1336 bytes} [Wed Aug 24 07:48:37 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:48:39.749015 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-3dde34a7-aeb2-438c-9eef-8510a4e2fc6b admin admin] Calling method '>' {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:39.750019 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-3dde34a7-aeb2-438c-9eef-8510a4e2fc6b admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 24 07:48:39.750420 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 9/16] 10.222.0.72 () {54 vars in 931 bytes} [Wed Aug 24 07:48:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:48:40.183919 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-5fbe1323-b5dc-4e3a-8a1b-97f6f9b5f569 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 4, "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "os-flavor-access:is_public": true, "swap": 0, "id": "d4"}} {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:40.271810 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-5fbe1323-b5dc-4e3a-8a1b-97f6f9b5f569 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.514404 Aug 24 07:48:40.272815 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 8/17] 10.222.0.72 () {64 vars in 1283 bytes} [Wed Aug 24 07:48:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:48:40.284554 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-84e02c36-3a7a-47ab-a5cb-7c4efa28c271 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:40.366801 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-84e02c36-3a7a-47ab-a5cb-7c4efa28c271 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085811 Aug 24 07:48:40.367294 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 10/18] 10.222.0.72 () {64 vars in 1336 bytes} [Wed Aug 24 07:48:40 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:48:42.766828 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-5fbe1323-b5dc-4e3a-8a1b-97f6f9b5f569 admin admin] Calling method '>' {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:42.768336 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-5fbe1323-b5dc-4e3a-8a1b-97f6f9b5f569 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001930 Aug 24 07:48:42.768846 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 9/19] 10.222.0.72 () {54 vars in 931 bytes} [Wed Aug 24 07:48:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:48:43.202338 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-1fde7a21-0f08-446b-b3a4-a21ba213423b admin admin] Calling method '>' {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:43.228311 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-1fde7a21-0f08-446b-b3a4-a21ba213423b admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.451443 Aug 24 07:48:43.228887 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 11/20] 10.222.0.72 () {60 vars in 1292 bytes} [Wed Aug 24 07:48:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:48:45.661912 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-5fbe1323-b5dc-4e3a-8a1b-97f6f9b5f569 admin admin] Calling method '>' {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:45.662923 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-5fbe1323-b5dc-4e3a-8a1b-97f6f9b5f569 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 24 07:48:45.663333 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 10/21] 10.222.0.72 () {54 vars in 931 bytes} [Wed Aug 24 07:48:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:48:46.092427 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-8fed2f85-4c23-46c7-920c-7a0f2bd42c8a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "id": "1"}} {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:46.174003 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-8fed2f85-4c23-46c7-920c-7a0f2bd42c8a admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.504387 Aug 24 07:48:46.174734 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 12/22] 10.222.0.72 () {64 vars in 1283 bytes} [Wed Aug 24 07:48:45 2022] POST /compute/v2.1/flavors => generated 402 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:48:46.188684 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-c1716231-b5bf-4c7c-8866-68f870fc292b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:46.277803 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-c1716231-b5bf-4c7c-8866-68f870fc292b admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092927 Aug 24 07:48:46.279127 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 11/23] 10.222.0.72 () {64 vars in 1333 bytes} [Wed Aug 24 07:48:46 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:48:48.668280 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-8fed2f85-4c23-46c7-920c-7a0f2bd42c8a admin admin] Calling method '>' {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:48.669393 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-8fed2f85-4c23-46c7-920c-7a0f2bd42c8a admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Aug 24 07:48:48.669806 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 13/24] 10.222.0.72 () {54 vars in 931 bytes} [Wed Aug 24 07:48:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:48:49.076415 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-2e278ea6-cdae-4ac7-9733-f73d7701701f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "2", "vcpus": 1, "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small"}} {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:49.150384 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-2e278ea6-cdae-4ac7-9733-f73d7701701f admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.474493 Aug 24 07:48:49.150959 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 12/25] 10.222.0.72 () {64 vars in 1283 bytes} [Wed Aug 24 07:48:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:48:49.163013 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-b643299c-208c-40b7-9da3-fab6015446eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:49.245945 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-b643299c-208c-40b7-9da3-fab6015446eb admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086458 Aug 24 07:48:49.246563 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 14/26] 10.222.0.72 () {64 vars in 1333 bytes} [Wed Aug 24 07:48:49 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:48:51.655628 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-2e278ea6-cdae-4ac7-9733-f73d7701701f admin admin] Calling method '>' {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:51.656696 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-2e278ea6-cdae-4ac7-9733-f73d7701701f admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 24 07:48:51.657343 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 13/27] 10.222.0.72 () {54 vars in 931 bytes} [Wed Aug 24 07:48:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:48:52.157666 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-eb34a2fd-1d37-4876-aef8-be41ec25dbdd admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "name": "m1.medium", "id": "3", "swap": 0, "ram": 4096, "rxtx_factor": 1.0}} {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:52.220171 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-eb34a2fd-1d37-4876-aef8-be41ec25dbdd admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.555811 Aug 24 07:48:52.221093 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 15/28] 10.222.0.72 () {64 vars in 1283 bytes} [Wed Aug 24 07:48:51 2022] POST /compute/v2.1/flavors => generated 406 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:48:52.233830 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-4b651736-ad86-4222-bdf5-a339df53ad0b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:52.299031 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-4b651736-ad86-4222-bdf5-a339df53ad0b admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.069201 Aug 24 07:48:52.299626 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 14/29] 10.222.0.72 () {64 vars in 1333 bytes} [Wed Aug 24 07:48:52 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:48:54.707311 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-eb34a2fd-1d37-4876-aef8-be41ec25dbdd admin admin] Calling method '>' {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:54.708328 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-eb34a2fd-1d37-4876-aef8-be41ec25dbdd admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Aug 24 07:48:54.708764 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 16/30] 10.222.0.72 () {54 vars in 931 bytes} [Wed Aug 24 07:48:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:48:55.164541 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-282f2c15-8e4d-45c2-8622-2d4cd1498b40 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "swap": 0, "disk": 80, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:55.170337 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG dbcounter [-] [112564] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:55.243157 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-282f2c15-8e4d-45c2-8622-2d4cd1498b40 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.528150 Aug 24 07:48:55.243927 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 15/31] 10.222.0.72 () {64 vars in 1283 bytes} [Wed Aug 24 07:48:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:48:55.256681 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-f2420e00-f5ca-49c2-a278-b233adf1cfaf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:55.333802 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-f2420e00-f5ca-49c2-a278-b233adf1cfaf admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081316 Aug 24 07:48:55.334380 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 17/32] 10.222.0.72 () {64 vars in 1333 bytes} [Wed Aug 24 07:48:55 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:48:57.770842 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-282f2c15-8e4d-45c2-8622-2d4cd1498b40 admin admin] Calling method '>' {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:57.772745 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-282f2c15-8e4d-45c2-8622-2d4cd1498b40 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 24 07:48:57.772745 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 16/33] 10.222.0.72 () {54 vars in 931 bytes} [Wed Aug 24 07:48:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:48:58.207007 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-87fc27b0-eb1d-4776-9d8e-cb8944700f93 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 160, "os-flavor-access:is_public": true, "vcpus": 8, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "id": "5", "ram": 16384}} {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:58.288561 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-87fc27b0-eb1d-4776-9d8e-cb8944700f93 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.509531 Aug 24 07:48:58.289661 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 18/34] 10.222.0.72 () {64 vars in 1283 bytes} [Wed Aug 24 07:48:57 2022] POST /compute/v2.1/flavors => generated 408 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:48:58.303012 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-75a3b430-fe00-4cd2-8538-f83f6e099785 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:58.441378 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-75a3b430-fe00-4cd2-8538-f83f6e099785 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.143055 Aug 24 07:48:58.452078 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 17/35] 10.222.0.72 () {64 vars in 1333 bytes} [Wed Aug 24 07:48:58 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:49:19.216440 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-87fc27b0-eb1d-4776-9d8e-cb8944700f93 admin admin] Calling method '>' {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:19.218079 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-87fc27b0-eb1d-4776-9d8e-cb8944700f93 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002707 Aug 24 07:49:19.218488 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 19/36] 10.222.0.72 () {54 vars in 931 bytes} [Wed Aug 24 07:49:19 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:49:19.606863 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-b1e80a48-436e-4772-b3be-ba08d5dd820a admin admin] Calling method '>' {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:19.625147 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-b1e80a48-436e-4772-b3be-ba08d5dd820a admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400097 Aug 24 07:49:19.625685 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 18/37] 10.222.0.72 () {60 vars in 1292 bytes} [Wed Aug 24 07:49:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:49:20.685218 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-87fc27b0-eb1d-4776-9d8e-cb8944700f93 admin admin] Calling method '>' {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:20.686225 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-87fc27b0-eb1d-4776-9d8e-cb8944700f93 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 24 07:49:20.686623 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 20/38] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Aug 24 07:49:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:49:21.210934 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-3ecf2362-0f70-4819-ad3a-81958a31586d admin admin] Calling method '>' {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:21.216482 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.wsgi [None req-3ecf2362-0f70-4819-ad3a-81958a31586d admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 07:49:21.219765 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-3ecf2362-0f70-4819-ad3a-81958a31586d admin admin] Request method failure captured: Aug 24 07:49:21.219765 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 07:49:21.219765 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: Accept: application/json Aug 24 07:49:21.219765 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: Accept-Encoding: gzip, deflate Aug 24 07:49:21.219765 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: Connection: keep-alive Aug 24 07:49:21.219765 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: Content-Length: 0 Aug 24 07:49:21.219765 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: Host: 10.222.0.72 Aug 24 07:49:21.219765 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: Openstack-Api-Version: compute 2.90 Aug 24 07:49:21.219765 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: Openstack-System-Scope: None Aug 24 07:49:21.219765 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: User-Agent: python-novaclient Aug 24 07:49:21.219765 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Auth-Token: gAAAAABjBdgA_BaLHrlzoD0npQHs5DxvqFVj3Qix8PANB38LTMEjfHHjO97tmGI9XZIoh7CTEtvUPt4_yRvYQKQ6xZe28_7DjBDGPgM4o6ddO9iJKcMws2wop4UfHJ_4kmgvhG7_veGR-ycSpjoKXEOH-Qh3KGw6FtPzITptwHA4jy1Osz-8nFs Aug 24 07:49:21.219765 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Domain-Id: None Aug 24 07:49:21.219765 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Domain-Name: None Aug 24 07:49:21.219765 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Identity-Status: Confirmed Aug 24 07:49:21.219765 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Is-Admin-Project: True Aug 24 07:49:21.219765 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 07:49:21.219765 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Project-Domain-Id: default Aug 24 07:49:21.219765 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Project-Domain-Name: Default Aug 24 07:49:21.219765 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Project-Id: 8d87d471ae2b4849a0dda41c93ab2dfd Aug 24 07:49:21.219765 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Project-Name: admin Aug 24 07:49:21.219765 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Role: admin,reader,member Aug 24 07:49:21.219765 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Roles: admin,reader,member Aug 24 07:49:21.222091 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8d87d471ae2b4849a0dda41c93ab2dfd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8d87d471ae2b4849a0dda41c93ab2dfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8d87d471ae2b4849a0dda41c93ab2dfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8d87d471ae2b4849a0dda41c93ab2dfd"}]}] Aug 24 07:49:21.222091 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Tenant: admin Aug 24 07:49:21.222091 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Tenant-Id: 8d87d471ae2b4849a0dda41c93ab2dfd Aug 24 07:49:21.222091 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Tenant-Name: admin Aug 24 07:49:21.222091 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-User: admin Aug 24 07:49:21.222091 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-User-Domain-Id: default Aug 24 07:49:21.222091 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-User-Domain-Name: Default Aug 24 07:49:21.222091 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-User-Id: 691d549b6a8240cfaab77208fe5f61bd Aug 24 07:49:21.222091 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-User-Name: admin Aug 24 07:49:21.222091 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: method: > Aug 24 07:49:21.222091 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: exception: Flavor 42 could not be found. Aug 24 07:49:21.222091 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: action_args: {'id': '42'} Aug 24 07:49:21.222091 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:49:21.222091 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:49:21.223195 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 07:49:21.223195 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 07:49:21.223195 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 07:49:21.223195 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 07:49:21.223195 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 07:49:21.223195 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 07:49:21.223195 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 07:49:21.223195 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 07:49:21.223195 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 07:49:21.223195 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:49:21.223195 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 07:49:21.223195 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 07:49:21.223195 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 07:49:21.223195 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi Aug 24 07:49:21.223195 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:49:21.223195 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi Aug 24 07:49:21.223195 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:49:21.223195 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:49:21.223195 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:49:21.224726 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:49:21.224726 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:49:21.224726 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:49:21.224726 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:49:21.224726 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 07:49:21.224726 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:49:21.224726 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 07:49:21.224726 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi Aug 24 07:49:21.224726 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:49:21.224726 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi Aug 24 07:49:21.224726 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:49:21.224726 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:49:21.224726 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:49:21.224726 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:49:21.224726 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:49:21.224726 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 07:49:21.224726 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi Aug 24 07:49:21.224726 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-3ecf2362-0f70-4819-ad3a-81958a31586d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:49:21.226049 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-3ecf2362-0f70-4819-ad3a-81958a31586d admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.396729 Aug 24 07:49:21.226049 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 19/39] 10.222.0.72 () {60 vars in 1190 bytes} [Wed Aug 24 07:49:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 07:49:21.231564 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-278ac63b-e102-4b98-a0da-03905df5c8b2 admin admin] Calling method '>' {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:21.236899 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG dbcounter [-] [112563] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=112563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:21.255382 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-278ac63b-e102-4b98-a0da-03905df5c8b2 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027427 Aug 24 07:49:21.255987 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 21/40] 10.222.0.72 () {60 vars in 1210 bytes} [Wed Aug 24 07:49:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:21.265772 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-d126d6c6-17c1-4a84-9245-a4dd0bab530a admin admin] Calling method '>' {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:21.290309 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-d126d6c6-17c1-4a84-9245-a4dd0bab530a admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028158 Aug 24 07:49:21.290847 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 20/41] 10.222.0.72 () {60 vars in 1210 bytes} [Wed Aug 24 07:49:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:21.300204 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-3e5488fb-05ee-426c-8e9b-48d2247b6a8f admin admin] Calling method '>' {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:21.306517 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.wsgi [None req-3e5488fb-05ee-426c-8e9b-48d2247b6a8f admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 07:49:21.309768 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-3e5488fb-05ee-426c-8e9b-48d2247b6a8f admin admin] Request method failure captured: Aug 24 07:49:21.309768 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 07:49:21.309768 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: Accept: application/json Aug 24 07:49:21.309768 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: Accept-Encoding: gzip, deflate Aug 24 07:49:21.309768 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: Connection: keep-alive Aug 24 07:49:21.309768 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: Content-Length: 0 Aug 24 07:49:21.309768 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: Host: 10.222.0.72 Aug 24 07:49:21.309768 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: Openstack-Api-Version: compute 2.90 Aug 24 07:49:21.309768 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: Openstack-System-Scope: None Aug 24 07:49:21.309768 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: User-Agent: python-novaclient Aug 24 07:49:21.309768 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Auth-Token: gAAAAABjBdgA_BaLHrlzoD0npQHs5DxvqFVj3Qix8PANB38LTMEjfHHjO97tmGI9XZIoh7CTEtvUPt4_yRvYQKQ6xZe28_7DjBDGPgM4o6ddO9iJKcMws2wop4UfHJ_4kmgvhG7_veGR-ycSpjoKXEOH-Qh3KGw6FtPzITptwHA4jy1Osz-8nFs Aug 24 07:49:21.309768 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Domain-Id: None Aug 24 07:49:21.309768 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Domain-Name: None Aug 24 07:49:21.309768 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Identity-Status: Confirmed Aug 24 07:49:21.309768 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Is-Admin-Project: True Aug 24 07:49:21.309768 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 07:49:21.309768 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Project-Domain-Id: default Aug 24 07:49:21.309768 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Project-Domain-Name: Default Aug 24 07:49:21.309768 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Project-Id: 8d87d471ae2b4849a0dda41c93ab2dfd Aug 24 07:49:21.309768 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Project-Name: admin Aug 24 07:49:21.309768 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Role: admin,reader,member Aug 24 07:49:21.309768 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Roles: admin,reader,member Aug 24 07:49:21.311280 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8d87d471ae2b4849a0dda41c93ab2dfd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8d87d471ae2b4849a0dda41c93ab2dfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8d87d471ae2b4849a0dda41c93ab2dfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8d87d471ae2b4849a0dda41c93ab2dfd"}]}] Aug 24 07:49:21.311280 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Tenant: admin Aug 24 07:49:21.311280 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Tenant-Id: 8d87d471ae2b4849a0dda41c93ab2dfd Aug 24 07:49:21.311280 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Tenant-Name: admin Aug 24 07:49:21.311280 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-User: admin Aug 24 07:49:21.311280 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-User-Domain-Id: default Aug 24 07:49:21.311280 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-User-Domain-Name: Default Aug 24 07:49:21.311280 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-User-Id: 691d549b6a8240cfaab77208fe5f61bd Aug 24 07:49:21.311280 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-User-Name: admin Aug 24 07:49:21.311280 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: method: > Aug 24 07:49:21.311280 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: exception: Flavor 42 could not be found. Aug 24 07:49:21.311280 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: action_args: {'id': '42'} Aug 24 07:49:21.311280 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:49:21.311280 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:49:21.312257 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 07:49:21.312257 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 07:49:21.312257 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 07:49:21.312257 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 07:49:21.312257 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 07:49:21.312257 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 07:49:21.312257 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 07:49:21.312257 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 07:49:21.312257 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 07:49:21.312257 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:49:21.312257 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 07:49:21.312257 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 07:49:21.312257 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 07:49:21.312257 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi Aug 24 07:49:21.312257 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:49:21.312257 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi Aug 24 07:49:21.312257 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:49:21.312257 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:49:21.312257 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:49:21.313551 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:49:21.313551 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:49:21.313551 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:49:21.313551 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:49:21.313551 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 07:49:21.313551 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:49:21.313551 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 07:49:21.313551 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi Aug 24 07:49:21.313551 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:49:21.313551 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi Aug 24 07:49:21.313551 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:49:21.313551 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:49:21.313551 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:49:21.313551 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:49:21.313551 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:49:21.313551 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 07:49:21.313551 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi Aug 24 07:49:21.313551 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-3e5488fb-05ee-426c-8e9b-48d2247b6a8f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:49:21.314755 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-3e5488fb-05ee-426c-8e9b-48d2247b6a8f admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014529 Aug 24 07:49:21.314755 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 22/42] 10.222.0.72 () {60 vars in 1190 bytes} [Wed Aug 24 07:49:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 07:49:22.277824 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-d126d6c6-17c1-4a84-9245-a4dd0bab530a admin admin] Calling method '>' {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:22.278867 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-d126d6c6-17c1-4a84-9245-a4dd0bab530a admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 24 07:49:22.279263 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 21/43] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Aug 24 07:49:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:49:22.793633 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-68da5eaf-ecb8-4424-a81b-2c297dbb71fc admin admin] Calling method '>' {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:22.798893 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.wsgi [None req-68da5eaf-ecb8-4424-a81b-2c297dbb71fc admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 07:49:22.800512 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-68da5eaf-ecb8-4424-a81b-2c297dbb71fc admin admin] Request method failure captured: Aug 24 07:49:22.800512 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 07:49:22.800512 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: Accept: application/json Aug 24 07:49:22.800512 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: Accept-Encoding: gzip, deflate Aug 24 07:49:22.800512 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: Connection: keep-alive Aug 24 07:49:22.800512 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: Content-Length: 0 Aug 24 07:49:22.800512 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: Host: 10.222.0.72 Aug 24 07:49:22.800512 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: Openstack-Api-Version: compute 2.90 Aug 24 07:49:22.800512 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: Openstack-System-Scope: None Aug 24 07:49:22.800512 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: User-Agent: python-novaclient Aug 24 07:49:22.800512 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Auth-Token: gAAAAABjBdgCF9nLM1uVjIigOcZ7HuHcFd5mowvsLR_SLBfqOB1i911w40Pf7n13hErE2Kv0GZ7G_Q3fAGzGu-J2yWKa8uLQHSRnfxyeda6bboP-fSKsrhLS059eHlNEEgSEKPBBqS__mp9OLoK9QYdjvmzz-n7CN8R52TAntQ9-WW3REHI-Nus Aug 24 07:49:22.800512 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Domain-Id: None Aug 24 07:49:22.800512 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Domain-Name: None Aug 24 07:49:22.800512 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Identity-Status: Confirmed Aug 24 07:49:22.800512 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Is-Admin-Project: True Aug 24 07:49:22.800512 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 07:49:22.800512 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Project-Domain-Id: default Aug 24 07:49:22.800512 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Project-Domain-Name: Default Aug 24 07:49:22.800512 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Project-Id: 8d87d471ae2b4849a0dda41c93ab2dfd Aug 24 07:49:22.800512 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Project-Name: admin Aug 24 07:49:22.800512 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Role: admin,reader,member Aug 24 07:49:22.800512 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Roles: admin,reader,member Aug 24 07:49:22.802273 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8d87d471ae2b4849a0dda41c93ab2dfd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8d87d471ae2b4849a0dda41c93ab2dfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8d87d471ae2b4849a0dda41c93ab2dfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8d87d471ae2b4849a0dda41c93ab2dfd"}]}] Aug 24 07:49:22.802273 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Tenant: admin Aug 24 07:49:22.802273 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Tenant-Id: 8d87d471ae2b4849a0dda41c93ab2dfd Aug 24 07:49:22.802273 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Tenant-Name: admin Aug 24 07:49:22.802273 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-User: admin Aug 24 07:49:22.802273 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-User-Domain-Id: default Aug 24 07:49:22.802273 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-User-Domain-Name: Default Aug 24 07:49:22.802273 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-User-Id: 691d549b6a8240cfaab77208fe5f61bd Aug 24 07:49:22.802273 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-User-Name: admin Aug 24 07:49:22.802273 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: method: > Aug 24 07:49:22.802273 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: exception: Flavor 84 could not be found. Aug 24 07:49:22.802273 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: action_args: {'id': '84'} Aug 24 07:49:22.802273 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:49:22.802273 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:49:22.803233 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 07:49:22.803233 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 07:49:22.803233 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 07:49:22.803233 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 07:49:22.803233 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 07:49:22.803233 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 07:49:22.803233 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 07:49:22.803233 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 07:49:22.803233 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 07:49:22.803233 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:49:22.803233 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 07:49:22.803233 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 07:49:22.803233 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 07:49:22.803233 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi Aug 24 07:49:22.803233 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:49:22.803233 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi Aug 24 07:49:22.803233 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:49:22.803233 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:49:22.803233 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:49:22.804314 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:49:22.804314 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:49:22.804314 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:49:22.804314 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:49:22.804314 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 07:49:22.804314 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:49:22.804314 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 07:49:22.804314 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi Aug 24 07:49:22.804314 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:49:22.804314 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi Aug 24 07:49:22.804314 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:49:22.804314 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:49:22.804314 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:49:22.804314 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:49:22.804314 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:49:22.804314 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 07:49:22.804314 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi Aug 24 07:49:22.804314 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-68da5eaf-ecb8-4424-a81b-2c297dbb71fc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:49:22.805438 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-68da5eaf-ecb8-4424-a81b-2c297dbb71fc admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.386843 Aug 24 07:49:22.805438 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 23/44] 10.222.0.72 () {60 vars in 1190 bytes} [Wed Aug 24 07:49:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 07:49:22.812122 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-b3ad9ce5-83cb-4d6b-a3f2-0c97f8fd5611 admin admin] Calling method '>' {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:22.826716 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-b3ad9ce5-83cb-4d6b-a3f2-0c97f8fd5611 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018270 Aug 24 07:49:22.827237 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 22/45] 10.222.0.72 () {60 vars in 1210 bytes} [Wed Aug 24 07:49:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:22.837076 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-c8b3c45f-ced5-4a8a-acb9-2d8261f29102 admin admin] Calling method '>' {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:22.854192 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-c8b3c45f-ced5-4a8a-acb9-2d8261f29102 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020559 Aug 24 07:49:22.854723 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 24/46] 10.222.0.72 () {60 vars in 1210 bytes} [Wed Aug 24 07:49:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:22.864086 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-c6ba62e7-69cc-4792-9d29-7b15cdbceaf7 admin admin] Calling method '>' {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:22.869340 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.wsgi [None req-c6ba62e7-69cc-4792-9d29-7b15cdbceaf7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 07:49:22.870804 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-c6ba62e7-69cc-4792-9d29-7b15cdbceaf7 admin admin] Request method failure captured: Aug 24 07:49:22.870804 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 07:49:22.870804 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: Accept: application/json Aug 24 07:49:22.870804 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: Accept-Encoding: gzip, deflate Aug 24 07:49:22.870804 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: Connection: keep-alive Aug 24 07:49:22.870804 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: Content-Length: 0 Aug 24 07:49:22.870804 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: Host: 10.222.0.72 Aug 24 07:49:22.870804 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: Openstack-Api-Version: compute 2.90 Aug 24 07:49:22.870804 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: Openstack-System-Scope: None Aug 24 07:49:22.870804 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: User-Agent: python-novaclient Aug 24 07:49:22.870804 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Auth-Token: gAAAAABjBdgCF9nLM1uVjIigOcZ7HuHcFd5mowvsLR_SLBfqOB1i911w40Pf7n13hErE2Kv0GZ7G_Q3fAGzGu-J2yWKa8uLQHSRnfxyeda6bboP-fSKsrhLS059eHlNEEgSEKPBBqS__mp9OLoK9QYdjvmzz-n7CN8R52TAntQ9-WW3REHI-Nus Aug 24 07:49:22.870804 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Domain-Id: None Aug 24 07:49:22.870804 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Domain-Name: None Aug 24 07:49:22.870804 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Identity-Status: Confirmed Aug 24 07:49:22.870804 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Is-Admin-Project: True Aug 24 07:49:22.870804 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 07:49:22.870804 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Project-Domain-Id: default Aug 24 07:49:22.870804 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Project-Domain-Name: Default Aug 24 07:49:22.870804 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Project-Id: 8d87d471ae2b4849a0dda41c93ab2dfd Aug 24 07:49:22.870804 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Project-Name: admin Aug 24 07:49:22.870804 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Role: admin,reader,member Aug 24 07:49:22.870804 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Roles: admin,reader,member Aug 24 07:49:22.872360 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8d87d471ae2b4849a0dda41c93ab2dfd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8d87d471ae2b4849a0dda41c93ab2dfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8d87d471ae2b4849a0dda41c93ab2dfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8d87d471ae2b4849a0dda41c93ab2dfd"}]}] Aug 24 07:49:22.872360 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Tenant: admin Aug 24 07:49:22.872360 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Tenant-Id: 8d87d471ae2b4849a0dda41c93ab2dfd Aug 24 07:49:22.872360 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Tenant-Name: admin Aug 24 07:49:22.872360 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-User: admin Aug 24 07:49:22.872360 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-User-Domain-Id: default Aug 24 07:49:22.872360 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-User-Domain-Name: Default Aug 24 07:49:22.872360 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-User-Id: 691d549b6a8240cfaab77208fe5f61bd Aug 24 07:49:22.872360 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-User-Name: admin Aug 24 07:49:22.872360 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: method: > Aug 24 07:49:22.872360 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: exception: Flavor 84 could not be found. Aug 24 07:49:22.872360 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: action_args: {'id': '84'} Aug 24 07:49:22.872360 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:49:22.872360 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:49:22.873245 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 07:49:22.873245 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 07:49:22.873245 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 07:49:22.873245 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 07:49:22.873245 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 07:49:22.873245 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 07:49:22.873245 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 07:49:22.873245 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 07:49:22.873245 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 07:49:22.873245 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:49:22.873245 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 07:49:22.873245 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 07:49:22.873245 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 07:49:22.873245 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi Aug 24 07:49:22.873245 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:49:22.873245 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi Aug 24 07:49:22.873245 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:49:22.873245 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:49:22.873245 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:49:22.874482 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:49:22.874482 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:49:22.874482 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:49:22.874482 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:49:22.874482 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 07:49:22.874482 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:49:22.874482 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 07:49:22.874482 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi Aug 24 07:49:22.874482 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:49:22.874482 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi Aug 24 07:49:22.874482 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:49:22.874482 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:49:22.874482 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:49:22.874482 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:49:22.874482 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:49:22.874482 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 07:49:22.874482 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi Aug 24 07:49:22.874482 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-c6ba62e7-69cc-4792-9d29-7b15cdbceaf7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:49:22.875720 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-c6ba62e7-69cc-4792-9d29-7b15cdbceaf7 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011735 Aug 24 07:49:22.875720 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 23/47] 10.222.0.72 () {60 vars in 1190 bytes} [Wed Aug 24 07:49:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 07:49:23.850713 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-c8b3c45f-ced5-4a8a-acb9-2d8261f29102 admin admin] Calling method '>' {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:23.851750 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-c8b3c45f-ced5-4a8a-acb9-2d8261f29102 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 24 07:49:23.852152 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 25/48] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Aug 24 07:49:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:49:24.374899 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-b5fb8064-2d18-4c4d-af42-6c5f720a3b36 admin admin] Calling method '>' {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:24.380738 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.wsgi [None req-b5fb8064-2d18-4c4d-af42-6c5f720a3b36 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 07:49:24.382253 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-b5fb8064-2d18-4c4d-af42-6c5f720a3b36 admin admin] Request method failure captured: Aug 24 07:49:24.382253 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 07:49:24.382253 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: Accept: application/json Aug 24 07:49:24.382253 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: Accept-Encoding: gzip, deflate Aug 24 07:49:24.382253 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: Connection: keep-alive Aug 24 07:49:24.382253 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: Content-Length: 0 Aug 24 07:49:24.382253 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: Host: 10.222.0.72 Aug 24 07:49:24.382253 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: Openstack-Api-Version: compute 2.90 Aug 24 07:49:24.382253 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: Openstack-System-Scope: None Aug 24 07:49:24.382253 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: User-Agent: python-novaclient Aug 24 07:49:24.382253 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Auth-Token: gAAAAABjBdgDlBNXC_mdzp5YbwFrH8T_coXFN27wd7cE7zEbHXKNZJNYNDT8cofwCD6WhUMTg1e-CLHfEW7eL-XwG7GBnxDYQU7W6cexlG-CYMB8OqWdtAfQC3DL8bdhy69QnXhSql7QvZDtEEinSa8ENbKzdB71MhmTmCO408g1EpUuQ974bDU Aug 24 07:49:24.382253 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Domain-Id: None Aug 24 07:49:24.382253 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Domain-Name: None Aug 24 07:49:24.382253 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Identity-Status: Confirmed Aug 24 07:49:24.382253 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Is-Admin-Project: True Aug 24 07:49:24.382253 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 07:49:24.382253 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Project-Domain-Id: default Aug 24 07:49:24.382253 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Project-Domain-Name: Default Aug 24 07:49:24.382253 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Project-Id: 8d87d471ae2b4849a0dda41c93ab2dfd Aug 24 07:49:24.382253 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Project-Name: admin Aug 24 07:49:24.382253 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Role: admin,reader,member Aug 24 07:49:24.382253 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Roles: admin,reader,member Aug 24 07:49:24.383530 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8d87d471ae2b4849a0dda41c93ab2dfd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8d87d471ae2b4849a0dda41c93ab2dfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8d87d471ae2b4849a0dda41c93ab2dfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8d87d471ae2b4849a0dda41c93ab2dfd"}]}] Aug 24 07:49:24.383530 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Tenant: admin Aug 24 07:49:24.383530 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Tenant-Id: 8d87d471ae2b4849a0dda41c93ab2dfd Aug 24 07:49:24.383530 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-Tenant-Name: admin Aug 24 07:49:24.383530 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-User: admin Aug 24 07:49:24.383530 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-User-Domain-Id: default Aug 24 07:49:24.383530 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-User-Domain-Name: Default Aug 24 07:49:24.383530 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-User-Id: 691d549b6a8240cfaab77208fe5f61bd Aug 24 07:49:24.383530 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: X-User-Name: admin Aug 24 07:49:24.383530 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: method: > Aug 24 07:49:24.383530 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: exception: Flavor 451 could not be found. Aug 24 07:49:24.383530 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: action_args: {'id': '451'} Aug 24 07:49:24.383530 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:49:24.383530 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:49:24.384304 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 07:49:24.384304 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 07:49:24.384304 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 07:49:24.384304 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 07:49:24.384304 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 07:49:24.384304 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 07:49:24.384304 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 07:49:24.384304 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 07:49:24.384304 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 07:49:24.384304 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:49:24.384304 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 07:49:24.384304 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 07:49:24.384304 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 07:49:24.384304 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi Aug 24 07:49:24.384304 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:49:24.384304 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi Aug 24 07:49:24.384304 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:49:24.384304 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:49:24.384304 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:49:24.385370 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:49:24.385370 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:49:24.385370 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:49:24.385370 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:49:24.385370 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 07:49:24.385370 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:49:24.385370 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 07:49:24.385370 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi Aug 24 07:49:24.385370 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:49:24.385370 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi Aug 24 07:49:24.385370 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:49:24.385370 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:49:24.385370 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:49:24.385370 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:49:24.385370 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:49:24.385370 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 07:49:24.385370 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: ERROR nova.api.openstack.wsgi Aug 24 07:49:24.385370 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-b5fb8064-2d18-4c4d-af42-6c5f720a3b36 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:49:24.386618 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-b5fb8064-2d18-4c4d-af42-6c5f720a3b36 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.395331 Aug 24 07:49:24.386618 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 24/49] 10.222.0.72 () {60 vars in 1193 bytes} [Wed Aug 24 07:49:23 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 07:49:24.393965 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-107519e0-7b28-4844-af07-2ed7d56bcd69 admin admin] Calling method '>' {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:24.409414 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-107519e0-7b28-4844-af07-2ed7d56bcd69 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019033 Aug 24 07:49:24.409961 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 26/50] 10.222.0.72 () {60 vars in 1210 bytes} [Wed Aug 24 07:49:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:49:24.419463 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-4d6d1f55-c8fe-438d-a926-062ba5fb516c admin admin] Calling method '>' {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:24.434690 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-4d6d1f55-c8fe-438d-a926-062ba5fb516c admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018724 Aug 24 07:49:24.435203 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 25/51] 10.222.0.72 () {60 vars in 1210 bytes} [Wed Aug 24 07:49:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:24.444503 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-b002ef55-b54a-477a-84f8-37fb97f48320 admin admin] Calling method '>' {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:24.449948 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.wsgi [None req-b002ef55-b54a-477a-84f8-37fb97f48320 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 07:49:24.451429 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-b002ef55-b54a-477a-84f8-37fb97f48320 admin admin] Request method failure captured: Aug 24 07:49:24.451429 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 07:49:24.451429 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: Accept: application/json Aug 24 07:49:24.451429 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: Accept-Encoding: gzip, deflate Aug 24 07:49:24.451429 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: Connection: keep-alive Aug 24 07:49:24.451429 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: Content-Length: 0 Aug 24 07:49:24.451429 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: Host: 10.222.0.72 Aug 24 07:49:24.451429 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: Openstack-Api-Version: compute 2.90 Aug 24 07:49:24.451429 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: Openstack-System-Scope: None Aug 24 07:49:24.451429 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: User-Agent: python-novaclient Aug 24 07:49:24.451429 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Auth-Token: gAAAAABjBdgDlBNXC_mdzp5YbwFrH8T_coXFN27wd7cE7zEbHXKNZJNYNDT8cofwCD6WhUMTg1e-CLHfEW7eL-XwG7GBnxDYQU7W6cexlG-CYMB8OqWdtAfQC3DL8bdhy69QnXhSql7QvZDtEEinSa8ENbKzdB71MhmTmCO408g1EpUuQ974bDU Aug 24 07:49:24.451429 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Domain-Id: None Aug 24 07:49:24.451429 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Domain-Name: None Aug 24 07:49:24.451429 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Identity-Status: Confirmed Aug 24 07:49:24.451429 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Is-Admin-Project: True Aug 24 07:49:24.451429 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 07:49:24.451429 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Project-Domain-Id: default Aug 24 07:49:24.451429 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Project-Domain-Name: Default Aug 24 07:49:24.451429 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Project-Id: 8d87d471ae2b4849a0dda41c93ab2dfd Aug 24 07:49:24.451429 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Project-Name: admin Aug 24 07:49:24.451429 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Role: admin,reader,member Aug 24 07:49:24.451429 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Roles: admin,reader,member Aug 24 07:49:24.453016 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8d87d471ae2b4849a0dda41c93ab2dfd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8d87d471ae2b4849a0dda41c93ab2dfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8d87d471ae2b4849a0dda41c93ab2dfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8d87d471ae2b4849a0dda41c93ab2dfd"}]}] Aug 24 07:49:24.453016 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Tenant: admin Aug 24 07:49:24.453016 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Tenant-Id: 8d87d471ae2b4849a0dda41c93ab2dfd Aug 24 07:49:24.453016 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-Tenant-Name: admin Aug 24 07:49:24.453016 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-User: admin Aug 24 07:49:24.453016 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-User-Domain-Id: default Aug 24 07:49:24.453016 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-User-Domain-Name: Default Aug 24 07:49:24.453016 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-User-Id: 691d549b6a8240cfaab77208fe5f61bd Aug 24 07:49:24.453016 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: X-User-Name: admin Aug 24 07:49:24.453016 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: method: > Aug 24 07:49:24.453016 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: exception: Flavor 451 could not be found. Aug 24 07:49:24.453016 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: action_args: {'id': '451'} Aug 24 07:49:24.453016 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:49:24.453016 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:49:24.453979 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 07:49:24.453979 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 07:49:24.453979 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 07:49:24.453979 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 07:49:24.453979 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 07:49:24.453979 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 07:49:24.453979 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 07:49:24.453979 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 07:49:24.453979 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 07:49:24.453979 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:49:24.453979 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 07:49:24.453979 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 07:49:24.453979 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 07:49:24.453979 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi Aug 24 07:49:24.453979 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:49:24.453979 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi Aug 24 07:49:24.453979 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:49:24.453979 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:49:24.453979 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:49:24.455947 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:49:24.455947 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:49:24.455947 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:49:24.455947 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:49:24.455947 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 07:49:24.455947 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:49:24.455947 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 07:49:24.455947 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi Aug 24 07:49:24.455947 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:49:24.455947 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi Aug 24 07:49:24.455947 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:49:24.455947 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:49:24.455947 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:49:24.455947 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:49:24.455947 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:49:24.455947 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 07:49:24.455947 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: ERROR nova.api.openstack.wsgi Aug 24 07:49:24.455947 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-b002ef55-b54a-477a-84f8-37fb97f48320 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:49:24.457169 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-b002ef55-b54a-477a-84f8-37fb97f48320 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011887 Aug 24 07:49:24.457169 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 27/52] 10.222.0.72 () {60 vars in 1193 bytes} [Wed Aug 24 07:49:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 07:49:25.451310 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-4d6d1f55-c8fe-438d-a926-062ba5fb516c admin admin] Calling method '>' {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:25.452357 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-4d6d1f55-c8fe-438d-a926-062ba5fb516c admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Aug 24 07:49:25.452777 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 26/53] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Aug 24 07:49:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:49:25.987508 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-2bd172f3-6ccf-41d2-a52b-087daafef8d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:49:26.059134 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-2bd172f3-6ccf-41d2-a52b-087daafef8d4 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.467777 Aug 24 07:49:26.059674 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 28/54] 10.222.0.72 () {64 vars in 1235 bytes} [Wed Aug 24 07:49:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:49:27.025823 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-4d6d1f55-c8fe-438d-a926-062ba5fb516c admin admin] Calling method '>' {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:27.026845 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-4d6d1f55-c8fe-438d-a926-062ba5fb516c admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 24 07:49:27.027250 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 27/55] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Aug 24 07:49:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:49:27.555285 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-892ebabd-b16b-4908-a1c4-0960f71fe6a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:49:27.612721 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-892ebabd-b16b-4908-a1c4-0960f71fe6a4 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.441821 Aug 24 07:49:27.613205 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 29/56] 10.222.0.72 () {64 vars in 1235 bytes} [Wed Aug 24 07:49:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:49:28.582952 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-4d6d1f55-c8fe-438d-a926-062ba5fb516c admin admin] Calling method '>' {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:28.583956 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-4d6d1f55-c8fe-438d-a926-062ba5fb516c admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Aug 24 07:49:28.584355 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 28/57] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Aug 24 07:49:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:49:29.103870 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-11b3b013-f844-4dc1-8cd5-c7127d6d2c2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:49:29.191508 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-11b3b013-f844-4dc1-8cd5-c7127d6d2c2c admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.468509 Aug 24 07:49:29.192045 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 30/58] 10.222.0.72 () {64 vars in 1235 bytes} [Wed Aug 24 07:49:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:49:30.191001 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-4d6d1f55-c8fe-438d-a926-062ba5fb516c admin admin] Calling method '>' {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:30.192004 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-4d6d1f55-c8fe-438d-a926-062ba5fb516c admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 24 07:49:30.192407 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 29/59] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Aug 24 07:49:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:49:30.717596 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-26c8c1f2-e75d-4b39-a97b-9e8b120afc61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:49:30.796311 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-26c8c1f2-e75d-4b39-a97b-9e8b120afc61 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.464522 Aug 24 07:49:30.796906 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 31/60] 10.222.0.72 () {64 vars in 1235 bytes} [Wed Aug 24 07:49:30 2022] POST /compute/v2.1/flavors => generated 409 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:49:31.762797 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-4d6d1f55-c8fe-438d-a926-062ba5fb516c admin admin] Calling method '>' {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:31.763813 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-4d6d1f55-c8fe-438d-a926-062ba5fb516c admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 24 07:49:31.764218 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 30/61] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Aug 24 07:49:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:49:32.291478 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-78a126f0-9a88-432a-ae70-f3554a42ae56 admin admin] Calling method '>' {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:32.312823 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-78a126f0-9a88-432a-ae70-f3554a42ae56 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.402442 Aug 24 07:49:32.313361 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 32/62] 10.222.0.72 () {60 vars in 1202 bytes} [Wed Aug 24 07:49:31 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:50:25.993767 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-4d6d1f55-c8fe-438d-a926-062ba5fb516c admin admin] Calling method '>' {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:25.994705 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-4d6d1f55-c8fe-438d-a926-062ba5fb516c admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 24 07:50:25.995107 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 31/63] 10.222.0.72 () {54 vars in 931 bytes} [Wed Aug 24 07:50:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:50:26.006239 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG dbcounter [-] [112563] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:26.401686 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-3adccc70-a93c-40dd-abb2-bfd17ba75464 admin admin] Calling method '>' {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:26.422532 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-3adccc70-a93c-40dd-abb2-bfd17ba75464 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.420724 Aug 24 07:50:26.423081 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 33/64] 10.222.0.72 () {60 vars in 1292 bytes} [Wed Aug 24 07:50:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:50:26.444767 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG dbcounter [-] [112564] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:26.448507 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-4fe63d61-a0c5-456c-aebe-97e1b1361336 admin admin] Calling method '>' {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:26.455946 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-4fe63d61-a0c5-456c-aebe-97e1b1361336 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012623 Aug 24 07:50:26.456448 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 32/65] 10.222.0.72 () {60 vars in 1283 bytes} [Wed Aug 24 07:50:26 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:26.467919 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-53441c7e-7ac7-4bc9-afd2-5eee10c9e48e admin admin] Calling method '>' {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:26.475564 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-53441c7e-7ac7-4bc9-afd2-5eee10c9e48e admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011201 Aug 24 07:50:26.476082 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 34/66] 10.222.0.72 () {60 vars in 1286 bytes} [Wed Aug 24 07:50:26 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:26.488878 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-ccf490c0-122f-4518-9064-762bc4c3c25c admin admin] Calling method '>' {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:26.496887 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-ccf490c0-122f-4518-9064-762bc4c3c25c admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011810 Aug 24 07:50:26.497348 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 33/67] 10.222.0.72 () {60 vars in 1286 bytes} [Wed Aug 24 07:50:26 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:26.509255 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-f00c2788-7a4c-4d68-be67-fbe18983ef61 admin admin] Calling method '>' {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:26.516664 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-f00c2788-7a4c-4d68-be67-fbe18983ef61 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010897 Aug 24 07:50:26.517187 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 35/68] 10.222.0.72 () {60 vars in 1283 bytes} [Wed Aug 24 07:50:26 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:53:30.533961 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-ccf490c0-122f-4518-9064-762bc4c3c25c admin admin] Calling method '>' {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:30.535010 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-ccf490c0-122f-4518-9064-762bc4c3c25c admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 24 07:53:30.535410 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 34/69] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Aug 24 07:53:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:53:30.678632 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG dbcounter [-] [112563] Writing DB stats nova_api:SELECT=6 {{(pid=112563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:30.839573 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-fa447795-3150-41fb-9e31-90633b811f4e admin admin] Calling method '>' {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:30.841900 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:53:30.841900 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: warnings.warn(msg) Aug 24 07:53:30.843002 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-fa447795-3150-41fb-9e31-90633b811f4e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:30.843471 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-fa447795-3150-41fb-9e31-90633b811f4e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:30.843905 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-fa447795-3150-41fb-9e31-90633b811f4e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:30.844619 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-fa447795-3150-41fb-9e31-90633b811f4e admin admin] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:30.845074 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-fa447795-3150-41fb-9e31-90633b811f4e admin admin] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:30.845483 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-fa447795-3150-41fb-9e31-90633b811f4e admin admin] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:30.879564 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-fa447795-3150-41fb-9e31-90633b811f4e admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.202659 Aug 24 07:53:30.880122 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 36/70] 10.222.0.72 () {60 vars in 1193 bytes} [Wed Aug 24 07:53:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:53:31.715810 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-ccf490c0-122f-4518-9064-762bc4c3c25c admin admin] Calling method '>' {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:31.717450 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-ccf490c0-122f-4518-9064-762bc4c3c25c admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 24 07:53:31.718019 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 35/71] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Aug 24 07:53:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:53:31.911546 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-b10c4956-a57e-40bd-94fc-febf784321ad admin admin] Calling method '>' {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:31.913929 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:53:31.913929 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: warnings.warn(msg) Aug 24 07:53:31.915010 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-b10c4956-a57e-40bd-94fc-febf784321ad admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:31.915483 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-b10c4956-a57e-40bd-94fc-febf784321ad admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:31.915896 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-b10c4956-a57e-40bd-94fc-febf784321ad admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:31.916592 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-b10c4956-a57e-40bd-94fc-febf784321ad admin admin] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:31.917048 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-b10c4956-a57e-40bd-94fc-febf784321ad admin admin] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:31.917451 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-b10c4956-a57e-40bd-94fc-febf784321ad admin admin] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:31.937308 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-b10c4956-a57e-40bd-94fc-febf784321ad admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079112 Aug 24 07:53:31.937795 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 37/72] 10.222.0.72 () {60 vars in 1193 bytes} [Wed Aug 24 07:53:31 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:53:43.191365 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-ccf490c0-122f-4518-9064-762bc4c3c25c admin admin] Calling method '>' {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:43.192404 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-ccf490c0-122f-4518-9064-762bc4c3c25c admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 24 07:53:43.192854 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 36/73] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Aug 24 07:53:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:53:43.367385 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG dbcounter [-] [112563] Writing DB stats nova_cell0:SELECT=4 {{(pid=112563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:43.368290 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG dbcounter [-] [112563] Writing DB stats nova_cell1:SELECT=4 {{(pid=112563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:43.368894 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG dbcounter [-] [112563] Writing DB stats nova_api:SELECT=8 {{(pid=112563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:43.424142 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-a4db30a0-163b-4bdb-9835-ae2c5677141e admin admin] Calling method '>' {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:43.426412 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:53:43.426412 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: warnings.warn(msg) Aug 24 07:53:43.427505 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-a4db30a0-163b-4bdb-9835-ae2c5677141e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:43.427967 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-a4db30a0-163b-4bdb-9835-ae2c5677141e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:43.428386 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-a4db30a0-163b-4bdb-9835-ae2c5677141e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:43.429110 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-a4db30a0-163b-4bdb-9835-ae2c5677141e admin admin] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:43.429539 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-a4db30a0-163b-4bdb-9835-ae2c5677141e admin admin] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:43.429941 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-a4db30a0-163b-4bdb-9835-ae2c5677141e admin admin] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:43.455428 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-a4db30a0-163b-4bdb-9835-ae2c5677141e admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.092329 Aug 24 07:53:43.456013 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 38/74] 10.222.0.72 () {60 vars in 1193 bytes} [Wed Aug 24 07:53:43 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:53:44.284036 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: DEBUG nova.api.openstack.wsgi [None req-ccf490c0-122f-4518-9064-762bc4c3c25c admin admin] Calling method '>' {{(pid=112564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:44.285286 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: INFO nova.api.openstack.requestlog [None req-ccf490c0-122f-4518-9064-762bc4c3c25c admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002041 Aug 24 07:53:44.285803 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: [pid: 112564|app: 0|req: 37/75] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Aug 24 07:53:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:53:44.479366 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG nova.api.openstack.wsgi [None req-a5a0aa0c-d921-49dc-add4-27dbe87c05d7 admin admin] Calling method '>' {{(pid=112563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:44.481820 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:53:44.481820 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: warnings.warn(msg) Aug 24 07:53:44.482904 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-a5a0aa0c-d921-49dc-add4-27dbe87c05d7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:44.483366 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-a5a0aa0c-d921-49dc-add4-27dbe87c05d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:44.483805 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-a5a0aa0c-d921-49dc-add4-27dbe87c05d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:44.484493 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-a5a0aa0c-d921-49dc-add4-27dbe87c05d7 admin admin] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:44.484949 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-a5a0aa0c-d921-49dc-add4-27dbe87c05d7 admin admin] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:44.485354 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: DEBUG oslo_concurrency.lockutils [None req-a5a0aa0c-d921-49dc-add4-27dbe87c05d7 admin admin] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:44.538184 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: INFO nova.api.openstack.requestlog [None req-a5a0aa0c-d921-49dc-add4-27dbe87c05d7 admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.113650 Aug 24 07:53:44.538680 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: [pid: 112563|app: 0|req: 39/76] 10.222.0.72 () {60 vars in 1193 bytes} [Wed Aug 24 07:53:44 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:54:40.708785 dv-cinder-854275-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 07:54:40.709448 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: Wed Aug 24 07:54:40 2022 - graceful shutdown triggered... Aug 24 07:54:40.709932 dv-cinder-854275-1-iscsi devstack@n-api.service[112563]: Gracefully killing worker 1 (pid: 112563)... Aug 24 07:54:40.710599 dv-cinder-854275-1-iscsi devstack@n-api.service[112564]: Gracefully killing worker 2 (pid: 112564)... Aug 24 07:54:41.710230 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: worker 1 buried after 1 seconds Aug 24 07:54:41.710230 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: worker 2 buried after 1 seconds Aug 24 07:54:41.710230 dv-cinder-854275-1-iscsi devstack@n-api.service[112562]: goodbye to uWSGI. Aug 24 07:54:41.711753 dv-cinder-854275-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 07:54:41.712309 dv-cinder-854275-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 07:54:41.715207 dv-cinder-854275-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 07:54:41.724817 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 07:54:41.727390 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 07:54:41 2022] *** Aug 24 07:54:41.727543 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 07:54:41.727659 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 07:54:41.727814 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: nodename: dv-cinder-854275-1-iscsi Aug 24 07:54:41.727814 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: machine: x86_64 Aug 24 07:54:41.727814 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: clock source: unix Aug 24 07:54:41.727814 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: pcre jit disabled Aug 24 07:54:41.727814 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: detected number of CPU cores: 4 Aug 24 07:54:41.727814 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: current working directory: / Aug 24 07:54:41.727814 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: detected binary path: /usr/bin/uwsgi-core Aug 24 07:54:41.727814 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: your processes number limit is 47680 Aug 24 07:54:41.727814 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: your memory page size is 4096 bytes Aug 24 07:54:41.727814 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: detected max file descriptor number: 2048 Aug 24 07:54:41.728491 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: lock engine: pthread robust mutexes Aug 24 07:54:41.728491 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: thunder lock: enabled Aug 24 07:54:41.728491 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 07:54:41.728491 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 07:54:41.772511 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: Python main interpreter initialized at 0x561b855729c0 Aug 24 07:54:41.772511 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: python threads support enabled Aug 24 07:54:41.772511 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: your server socket listen backlog is limited to 100 connections Aug 24 07:54:41.772511 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: your mercy for graceful operations on workers is 90 seconds Aug 24 07:54:41.773001 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 07:54:41.773001 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: *** Operational MODE: preforking *** Aug 24 07:54:41.773276 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: *** uWSGI is running in multiple interpreter mode *** Aug 24 07:54:41.773276 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: spawned uWSGI master process (pid: 127566) Aug 24 07:54:41.773498 dv-cinder-854275-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 07:54:41.774079 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: spawned uWSGI worker 1 (pid: 127589, cores: 1) Aug 24 07:54:41.774442 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: spawned uWSGI worker 2 (pid: 127590, cores: 1) Aug 24 07:54:41.774592 dv-cinder-854275-1-iscsi devstack@n-api.service[127566]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 07:54:42.444768 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 07:54:42.449034 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 07:54:43.619636 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:54:43.619636 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: from cryptography.utils import int_from_bytes Aug 24 07:54:43.620379 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:54:43.620379 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: from cryptography.utils import int_from_bytes Aug 24 07:54:43.623186 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:54:43.623186 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: from cryptography.utils import int_from_bytes Aug 24 07:54:43.623676 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:54:43.623676 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: from cryptography.utils import int_from_bytes Aug 24 07:54:46.121150 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 07:54:46.121862 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 07:54:46.121862 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 07:54:46.122249 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 07:54:46.122472 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 07:54:46.122976 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.123308 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.123633 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.123955 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.124450 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.124800 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.125134 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.125462 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.125807 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.126071 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.126395 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.126725 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854275-1-iscsi {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.127052 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.127366 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.127683 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.128020 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.128319 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.128676 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.128980 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.129494 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.130861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.130861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.130861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.130861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.131205 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.131504 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.131806 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.132120 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.132450 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.132786 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.133200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854275-1-iscsi {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.133525 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.133835 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.134146 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.134575 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.134889 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.135213 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.135525 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.135861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.136158 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.136507 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.136833 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.137164 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.137473 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.137779 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.138091 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.138455 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.138781 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.139090 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.139397 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.139645 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.139957 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.140279 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.140599 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.140949 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.141202 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.141452 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.141772 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.142097 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.142410 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.142720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.143042 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.143341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.143649 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.143876 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 07:54:46.144393 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.144562 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 07:54:46.144824 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.144824 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.145130 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 07:54:46.145294 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.145441 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 07:54:46.145587 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.145738 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 07:54:46.145898 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.146051 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.146212 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.146370 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.146517 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.146672 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.146836 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.146991 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.147147 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.147147 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.147458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.147458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.147762 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.147922 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.148080 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.148080 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.148399 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.148577 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.148837 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.148837 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.149162 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.149162 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.149467 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.149615 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.149791 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854275-1-iscsi {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.149968 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.150120 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.150266 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.150420 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.150573 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.150747 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.150747 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.151037 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.151190 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.151335 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.151491 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.151651 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.151799 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.151944 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.151944 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.152915 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.155383 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.155746 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.155901 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.156057 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.156299 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.156457 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.156605 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.156804 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.156955 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.157107 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.157300 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.157453 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.157610 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.157610 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.157610 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.159083 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.159250 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.159401 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.159567 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.159724 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.159880 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.160042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.160204 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.160204 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.160505 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854275-1-iscsi {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.162222 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.167768 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.167949 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.168106 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.168255 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.168409 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.168568 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.168753 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.168964 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.169135 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.169297 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.169445 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.170248 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.170418 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.170565 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.170808 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.170982 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.170982 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.171375 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.172009 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.172181 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.172363 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.179585 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.179770 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.179939 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.180094 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.180265 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.180430 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.180585 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.180852 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.181015 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.181175 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.181331 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.181495 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.181689 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.182363 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.182533 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.182722 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.182874 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.184674 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.184781 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.184858 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.184930 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.185018 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.185101 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.185398 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.185398 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.185545 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.185615 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.185691 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.185691 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.185838 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.185915 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.185988 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.186065 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.186137 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.186227 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.186302 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.186380 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.186463 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.186541 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.186621 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.186693 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.186770 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.186848 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.186919 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.186989 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.187071 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.187151 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.187245 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.187329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.187400 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.187491 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.187575 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.187658 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.187738 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.187817 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.187888 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.188010 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.188085 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.188155 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.188231 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.188304 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.188379 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.188460 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.188532 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.188610 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.188707 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.192155 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.192299 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.192403 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.192489 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.192581 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.192689 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.192768 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.192852 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.192940 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.193145 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.193231 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.193309 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.193389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.193471 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.193551 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.193624 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.193694 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.193763 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.193832 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.193910 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.193983 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.194062 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.194144 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.194216 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.194293 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.194375 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.194447 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.194528 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.194608 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.194680 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.194680 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.194844 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.194929 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.195009 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.195088 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.195088 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.195225 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.195296 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.195296 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.195422 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.195497 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.195575 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.195656 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.195735 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.195814 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.195885 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.195962 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.196034 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.196300 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.196379 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.196449 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.196526 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.196598 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.196697 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.196794 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.196880 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.196952 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.197029 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.197111 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.197183 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.197270 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.197343 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.197428 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.197506 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.197588 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.197688 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.197761 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.197837 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.197916 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.197916 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.197916 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.198203 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.198285 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.198364 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.198444 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.198522 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.198601 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.198679 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.198750 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.198827 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.198916 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.199004 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.199083 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.199332 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.199413 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.199413 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.200629 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.200843 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.200843 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.201221 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.201383 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.201527 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.201669 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.201822 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.201976 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.202134 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.202278 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.202427 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.202570 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.202721 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.202873 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.203519 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.203694 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.203847 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.204001 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.204156 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.204306 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.204450 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.204592 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.205243 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.205416 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.205569 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.205721 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.206050 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.206199 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.206199 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.206495 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.206646 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.206797 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.206940 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.207090 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.207240 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.207398 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.207596 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.207752 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.207896 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.208039 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.208194 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.208358 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.208509 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.208669 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.208829 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.208829 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.209110 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:54:46.209264 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.209414 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.209563 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.209721 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.209870 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.209870 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.209870 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.210299 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.210449 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.210449 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.210718 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.210872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.210872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.211222 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.211384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.211384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.211674 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.211828 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.211828 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.212116 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.212262 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.212262 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.212546 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.212754 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.212754 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.213040 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.213189 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.213350 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.213506 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.213725 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.213725 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.214013 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.214176 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.214327 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.214482 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.214669 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.214817 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.214965 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.215396 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.215563 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.215716 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.215858 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.215999 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.216147 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.216326 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.220779 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.220951 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.221098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.221098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.221435 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.221579 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.221736 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.221880 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.222028 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.222188 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.222339 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.222501 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.222671 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.222817 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.222965 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.223118 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.223261 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.223412 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.223563 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.223713 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.223859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.224000 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.224142 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.224292 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.224441 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.224594 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.224777 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.224923 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.225073 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.225245 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.225665 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.225817 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.225968 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.226117 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.226261 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.226417 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.226572 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.226733 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.226889 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.227033 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.227188 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.227339 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.227489 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.227632 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.227826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.227978 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.228137 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.228289 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.228449 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.228600 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.228894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.229071 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.229296 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.229498 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.229646 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.229796 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.229796 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.229796 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.229796 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.229796 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.229796 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.229796 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.230825 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.230987 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.231140 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.231353 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.231503 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.231645 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.231794 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.231950 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.232178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.232897 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.233077 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.233222 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.233375 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.233529 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.233529 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.233810 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.233963 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.234106 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.234253 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.234417 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.234561 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.234709 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.234852 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.234999 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.235142 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.235295 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.235439 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.235876 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.236036 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.236181 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.236336 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.236482 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.236642 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.236941 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.237097 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.237242 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.237396 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.237548 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.237691 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.237831 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.237831 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.238108 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.238259 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.238409 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.238561 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.238703 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.238853 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.238995 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.239149 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.239292 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.239432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.239572 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.239729 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.239885 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.240028 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.240169 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.240316 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.240464 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.240613 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.240800 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.240954 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.241105 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.241248 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.241435 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.241588 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.241758 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.241901 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.242049 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.242192 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.242341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.242341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.242621 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.242765 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.242914 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.243063 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.243205 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.243360 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.243503 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.243655 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.243803 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.243951 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.244094 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.244247 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.244391 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.244533 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.244711 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.244861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.245012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.245165 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.245349 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.245500 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.245684 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.246168 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.246323 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.246519 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.246696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.246840 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.246991 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.247135 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.247297 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.247451 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.248250 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.248427 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.248573 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.248573 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.248870 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.249014 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.249156 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.249310 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.249460 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.249611 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.249760 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.249903 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.250054 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.250216 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.250360 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.250510 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.250660 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.250803 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.250997 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.251121 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.251233 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.251352 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.251534 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.251662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.251774 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.251884 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.252000 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.252126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.252246 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.252358 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.252467 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.252575 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.255446 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.255617 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.255764 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.255907 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.256390 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.256554 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.256722 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.256900 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.257052 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.257197 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.257348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.257500 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.257644 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.257796 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.257946 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.258099 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.258242 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.258395 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.258546 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.258717 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.258872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.259014 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.259163 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.259314 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.259473 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.259624 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.259782 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.259926 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.260075 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.260232 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.260389 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.260542 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.260735 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.260904 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.261056 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.261208 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.261437 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.261903 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.262062 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.262236 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.262446 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.262659 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.262901 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.263580 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.263734 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.263834 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.263928 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.264020 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.264107 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.264215 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.264311 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.264410 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.264502 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.264597 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.264707 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.264794 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.264889 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.264982 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.265067 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.265067 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.265067 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.265067 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.265067 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.265452 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.265547 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.265641 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.265734 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.265826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.265910 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.265993 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.266090 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.266312 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.266544 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.266639 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.266763 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.266861 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.266957 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.267050 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.267141 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.267233 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.267325 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.267411 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.267508 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.267600 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.267693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.267786 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.267878 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.267973 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.268065 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.268158 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.268251 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.268336 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.268419 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.268511 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.268599 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.268751 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.268840 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.268924 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.269015 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.269114 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.269200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.269290 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.269375 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.269465 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.269549 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.269642 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.269733 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.269818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.269908 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.269993 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.270084 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.270177 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.270268 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.270361 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.270452 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.270452 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.270614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.270699 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.270788 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.270873 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.270954 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.271044 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.271141 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.271233 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.271318 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.271400 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.271483 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.271565 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.271698 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.271799 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.271884 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.271974 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.272059 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.272162 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.272249 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.272340 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.272432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.272517 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.272599 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.272711 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.272824 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.272914 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.272999 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.273078 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.273163 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.273432 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.273432 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.273750 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.273854 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.273941 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.274025 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.274119 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.274212 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.274297 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.274388 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.274481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.274481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.274645 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.274728 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.274818 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.274911 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.274995 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.275088 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.275180 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.275273 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.275357 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.275447 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.275532 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.275624 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.275716 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.275802 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.275884 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.275966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.276049 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.276049 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.276218 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.276317 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.276403 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.276493 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.276602 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.276812 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.276900 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.277007 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.277095 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.277187 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.277282 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.277367 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.277458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.277543 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.277626 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.277709 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.277839 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.277934 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.278026 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.278117 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.278216 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.278302 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.278385 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.278474 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.278573 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.278666 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.278752 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.278835 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.279442 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.279531 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.279622 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.279717 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.279802 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.279884 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.279973 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.280065 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.280158 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.280256 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.280348 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.280433 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.280523 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.280607 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.280717 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.280813 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.280906 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.280991 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.281081 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.281166 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.281259 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.281344 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.281428 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.281511 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.281511 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.281511 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.281511 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.281511 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.281905 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.282003 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.282089 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.282172 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.282340 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.282340 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.282494 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.282494 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.282644 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.282726 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.282817 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.282902 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.282985 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.283068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.283151 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.283243 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.283336 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.283451 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.283533 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.283605 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.283674 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.283974 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.284064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.284157 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.284237 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.284316 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.284387 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.284478 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.284564 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.284674 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.284762 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.284834 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.284918 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.284998 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.285079 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.285151 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.285220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.285296 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.285382 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.285463 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.285543 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.285621 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.285693 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.285762 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.285841 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.285913 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.285990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.286061 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.286138 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.286215 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.286367 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.286448 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.286521 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.286590 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.286659 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.286735 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.286840 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.286840 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.286980 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.287053 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.287122 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.287205 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.287277 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.287354 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.287426 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.287494 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.287571 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.287660 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.287660 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.287660 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.287660 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.287913 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.287983 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.288060 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.288132 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.288201 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.288277 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.288355 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.288436 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.288528 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.288607 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.288708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.288790 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.288861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.288946 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.289028 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.289101 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.289178 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.289249 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.289326 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.290233 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.290357 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.290440 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.290440 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.290597 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.290597 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.290754 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.292678 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.292798 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.292798 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.292798 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.293056 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.293144 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.293230 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.293315 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.293399 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.293482 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.293581 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.293672 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.293748 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.293826 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.293907 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.293980 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.294154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.294252 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.294473 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.294613 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.295435 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.295545 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.295800 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.295897 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.296121 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.296223 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.296432 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.296537 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.296766 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.296874 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.297099 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.297220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.297409 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.297522 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.297725 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.297825 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.298043 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.298138 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.298375 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.298479 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.298704 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.298808 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.299018 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.299113 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.299349 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.299455 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.299666 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.299817 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.299976 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.300148 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.300288 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.300474 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.300599 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.300884 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.300978 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.301207 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.301316 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.301536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.301630 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.301861 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.301955 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.302188 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.302296 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.302504 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.302605 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.302819 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.302912 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.303152 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.303256 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.303478 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.303574 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.303798 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.303890 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.304126 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.304278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.304436 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.304614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.304751 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.304972 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.305078 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.305287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.305392 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.305610 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.305730 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.305932 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.306027 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.306248 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.306342 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.306567 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.306728 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.306886 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.306979 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.307209 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.307310 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.307528 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.307636 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.307836 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.307944 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.308159 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.308253 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.308470 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.308573 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.308801 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.308909 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.309112 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.309214 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.309420 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.309528 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.309769 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.309885 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.310077 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.310192 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.310433 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.310527 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.310746 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.310848 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.311063 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.311167 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.311376 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.311471 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.311693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.311785 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.312003 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.312104 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.312321 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.312451 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.312639 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.312809 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.312982 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.313110 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.313301 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.313426 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.313615 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.313747 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.313936 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.314167 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.314304 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.314509 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.314606 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.314833 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.315112 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.315218 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.315447 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.315550 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.315771 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.315875 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.316089 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.316193 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.316407 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.316501 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.316757 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.316867 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.317079 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.317183 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.317396 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.317490 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.317710 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.317803 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.318021 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.318121 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.318332 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.318434 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.318644 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.318745 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.318975 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.319077 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.319286 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.319380 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.319615 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.319709 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.319941 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.320046 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.320259 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.320353 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.320578 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.320714 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.320922 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.321076 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.321283 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.321389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.321603 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.321712 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.321914 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.322018 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.322232 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.322327 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.322550 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.322652 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.322868 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.323032 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.323175 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.323365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.323487 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.323777 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.323872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.324117 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.324231 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.324428 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.324585 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.324764 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.324898 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.325080 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.325223 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.325400 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.325539 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.325733 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.326396 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.326594 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.326731 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.326918 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.327056 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.327236 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.327389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.327556 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.327810 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.327920 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.328143 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.328382 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.328484 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.328720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.328821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.329057 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.329219 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.329384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.329536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.329709 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.329849 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.330030 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.330172 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.330348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.330483 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.330678 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.330788 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.330988 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.331113 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.331297 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.331426 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.331611 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.331745 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.331923 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.332062 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.332232 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.332376 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.332557 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.332729 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.332979 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.333084 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.333288 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.333391 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.333611 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.333716 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.333924 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.334026 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.334351 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.334549 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.334672 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.334913 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.335014 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.335240 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.335347 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.335569 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.335677 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.335888 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.335986 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.336201 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.336300 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.336514 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.336622 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.336852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.336963 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.337199 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.337295 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.337510 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.337682 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.337830 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.337924 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.338147 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.338249 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.338457 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.338563 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.338776 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.338952 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.339088 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.339210 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.339403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.339545 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.339714 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.339872 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.340031 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.340200 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.340327 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.340685 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.340873 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.340991 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.341196 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.341291 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.341562 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.342176 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.342472 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.342573 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.342783 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.342893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.343094 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.343196 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.343403 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.343495 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.343711 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.343818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.344018 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.344112 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.344326 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.344436 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.344634 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.344774 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.344976 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.345086 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.345290 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.345397 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.345597 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.345705 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.345913 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.346009 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.346224 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.346325 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.346535 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.346637 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.346844 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.346940 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.347192 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.347288 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.347504 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.347601 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.347817 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.347913 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.348138 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.348239 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.348451 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.348546 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.348789 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.348889 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.349122 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.349214 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.349444 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.349540 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.349765 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.349982 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.350072 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.350328 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.350436 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.350652 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.350751 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.350992 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.351090 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.351314 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.351411 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.351622 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.351720 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.351932 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.352031 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.352244 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.352484 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.352598 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.352847 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.352953 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.353169 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.353284 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.353489 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.353586 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.353809 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.353905 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.354122 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.354224 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.354440 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.354525 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.354758 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.354865 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.355075 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.355185 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.355392 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.355509 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.355705 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.355801 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.356020 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.356127 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.356338 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.356433 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.356670 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.356782 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.356984 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.357100 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.357341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.357490 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.357688 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.357799 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.358008 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.358103 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.358327 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.358422 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.358647 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.358754 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.358970 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.359065 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.359285 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.359390 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.359598 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.359695 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.359911 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.360005 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.360223 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.360321 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.360541 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.360703 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.360881 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.360986 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.361203 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.361312 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.361510 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.361613 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.361825 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.361926 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.362140 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.362245 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.362458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.362566 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.362857 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.363032 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.363173 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.363367 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.363498 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.363706 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.363823 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.364033 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.364145 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.364353 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.364446 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.364694 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.364802 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.365022 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.365155 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.365422 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.365535 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.365754 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.365866 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.366082 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.366193 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.366395 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.366493 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.366702 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.366801 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.367011 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.367136 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.367323 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.367420 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.367645 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.367742 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.367958 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.368057 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.368265 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.368359 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.368573 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.368710 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.368927 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.369025 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.369237 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.369341 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.369546 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.369643 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.369856 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.369961 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.370163 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.370256 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.370475 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.370585 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.370784 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.370891 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.371088 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.371436 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.371536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.371697 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.371824 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.372004 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.372147 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.372310 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.372479 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.372688 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.372877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.372974 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.373202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.373298 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.373517 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.373623 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.373845 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.373947 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.374155 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.374249 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.374463 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.374557 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.374787 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.374894 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.375105 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.375213 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.375427 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.375549 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.375743 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.375847 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.376070 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.376161 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.376392 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.376479 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.376743 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.376831 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.377067 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.377165 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.377379 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.377464 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.377693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.377786 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.378011 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.378104 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.378322 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.378413 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.378632 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.378722 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.381064 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.381208 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.381208 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.381381 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.381469 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.381556 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.381643 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.381740 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.381838 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.381935 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.382024 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.382110 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.382196 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.382296 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.382386 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.382471 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.382557 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.382642 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.382726 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.382825 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.382922 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.383010 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.383111 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.383201 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.383298 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.383400 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.383490 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.383583 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.383671 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.383756 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.383856 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.383944 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.384030 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.384123 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.384212 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.384307 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.384436 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.384542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.384794 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.384916 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.385193 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.385377 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.385491 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.385580 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.385734 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.385852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.386211 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.386337 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.386541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.386650 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.386858 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.386978 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.387187 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.387298 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.387518 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.387622 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.387868 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.387964 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.388184 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.388822 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.389238 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.389342 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.389650 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.389771 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.389966 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.390259 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.390356 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.390578 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.390752 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.390898 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 07:54:46.391253 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.391592 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.391912 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.392230 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.392550 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.392893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.393211 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.393872 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.394202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.394521 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.394839 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.395155 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.395479 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.395893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.396149 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.396474 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.396849 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.397176 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.397521 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.397839 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.398157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.398470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.398790 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.399124 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.399451 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.399765 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.400197 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.400518 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.400940 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.401187 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.401681 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.402018 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.402350 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.402672 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.404696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.404696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.404696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.404696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.405164 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.405280 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.406157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.406157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.406157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.406429 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.406702 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.407015 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.407326 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.407635 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.407949 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.408258 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.408568 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.408902 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.409210 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.409528 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.409834 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.410140 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.410447 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.410753 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.411059 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.411366 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.411677 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.411984 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.412291 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.412682 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.412980 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.413289 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.420088 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.420088 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.420088 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.420088 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.420088 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.420088 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.420088 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.420088 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.420813 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.420813 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.420813 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.420813 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.420813 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.420813 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.420813 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.420813 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.421532 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.421532 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.421532 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.421532 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.421532 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.421532 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.421532 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.421532 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.422171 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.422171 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.422171 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.422457 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.422775 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.423091 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.423407 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.423721 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.424039 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.424354 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.424682 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.425007 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.425326 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.425656 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.425984 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.426301 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.426628 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.426957 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.427348 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.427664 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.428029 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.428341 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.428670 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.429069 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.429364 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:54:46.429611 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 07:54:46.453157 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO dbcounter [None req-6b495756-eaf9-4396-a2c1-8487f3bb37b7 None None] Registered counter for database nova_api Aug 24 07:54:46.474101 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_db.sqlalchemy.engines [None req-6b495756-eaf9-4396-a2c1-8487f3bb37b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:54:46.480830 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writer thread running {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:54:46.492064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO dbcounter [None req-7e50b475-b056-4315-8d18-4ed80a66c18c None None] Registered counter for database nova_api Aug 24 07:54:46.512566 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_db.sqlalchemy.engines [None req-7e50b475-b056-4315-8d18-4ed80a66c18c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127589) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:54:46.519865 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writer thread running {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:54:46.538299 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.context [None req-6b495756-eaf9-4396-a2c1-8487f3bb37b7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bfac71ef-5ab0-4896-a5e4-5bd5fe410926(cell1) {{(pid=127590) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 07:54:46.542684 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6b495756-eaf9-4396-a2c1-8487f3bb37b7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:46.543164 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6b495756-eaf9-4396-a2c1-8487f3bb37b7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:46.544797 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6b495756-eaf9-4396-a2c1-8487f3bb37b7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:46.545536 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6b495756-eaf9-4396-a2c1-8487f3bb37b7 None None] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:46.545982 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6b495756-eaf9-4396-a2c1-8487f3bb37b7 None None] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:46.547959 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6b495756-eaf9-4396-a2c1-8487f3bb37b7 None None] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:46.549976 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO dbcounter [None req-6b495756-eaf9-4396-a2c1-8487f3bb37b7 None None] Registered counter for database nova_cell0 Aug 24 07:54:46.554162 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO dbcounter [None req-6b495756-eaf9-4396-a2c1-8487f3bb37b7 None None] Registered counter for database nova_cell1 Aug 24 07:54:46.564143 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_db.sqlalchemy.engines [None req-6b495756-eaf9-4396-a2c1-8487f3bb37b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:54:46.566330 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_db.sqlalchemy.engines [None req-6b495756-eaf9-4396-a2c1-8487f3bb37b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:54:46.574581 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writer thread running {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:54:46.576721 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writer thread running {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:54:46.578795 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.context [None req-7e50b475-b056-4315-8d18-4ed80a66c18c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bfac71ef-5ab0-4896-a5e4-5bd5fe410926(cell1) {{(pid=127589) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 07:54:46.582901 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7e50b475-b056-4315-8d18-4ed80a66c18c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:46.583382 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7e50b475-b056-4315-8d18-4ed80a66c18c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:46.584990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7e50b475-b056-4315-8d18-4ed80a66c18c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:46.585727 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7e50b475-b056-4315-8d18-4ed80a66c18c None None] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:46.586173 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7e50b475-b056-4315-8d18-4ed80a66c18c None None] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:46.588159 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7e50b475-b056-4315-8d18-4ed80a66c18c None None] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:46.590171 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO dbcounter [None req-7e50b475-b056-4315-8d18-4ed80a66c18c None None] Registered counter for database nova_cell0 Aug 24 07:54:46.594868 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO dbcounter [None req-7e50b475-b056-4315-8d18-4ed80a66c18c None None] Registered counter for database nova_cell1 Aug 24 07:54:46.602740 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_db.sqlalchemy.engines [None req-7e50b475-b056-4315-8d18-4ed80a66c18c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127589) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:54:46.605113 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_db.sqlalchemy.engines [None req-7e50b475-b056-4315-8d18-4ed80a66c18c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127589) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:54:46.610730 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writer thread running {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:54:46.612012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writer thread running {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:54:46.726243 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO dbcounter [None req-6b495756-eaf9-4396-a2c1-8487f3bb37b7 None None] Registered counter for database nova_cell0 Aug 24 07:54:46.733751 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_db.sqlalchemy.engines [None req-6b495756-eaf9-4396-a2c1-8487f3bb37b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:54:46.738530 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writer thread running {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:54:46.761307 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO dbcounter [None req-7e50b475-b056-4315-8d18-4ed80a66c18c None None] Registered counter for database nova_cell0 Aug 24 07:54:46.768861 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_db.sqlalchemy.engines [None req-7e50b475-b056-4315-8d18-4ed80a66c18c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127589) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:54:46.773954 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writer thread running {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:54:47.066939 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: WARNING keystonemiddleware.auth_token [None req-6b495756-eaf9-4396-a2c1-8487f3bb37b7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 07:54:47.074468 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: WARNING keystonemiddleware.auth_token [None req-6b495756-eaf9-4396-a2c1-8487f3bb37b7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 07:54:47.098428 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: WARNING keystonemiddleware.auth_token [None req-7e50b475-b056-4315-8d18-4ed80a66c18c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 07:54:47.105918 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: WARNING keystonemiddleware.auth_token [None req-7e50b475-b056-4315-8d18-4ed80a66c18c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 07:54:47.423034 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: WARNING keystonemiddleware.auth_token [None req-6b495756-eaf9-4396-a2c1-8487f3bb37b7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 07:54:47.429509 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: WARNING keystonemiddleware.auth_token [None req-6b495756-eaf9-4396-a2c1-8487f3bb37b7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 07:54:47.436132 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561b855729c0 pid: 127590 (default app) Aug 24 07:54:47.455834 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: WARNING keystonemiddleware.auth_token [None req-7e50b475-b056-4315-8d18-4ed80a66c18c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 07:54:47.461865 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: WARNING keystonemiddleware.auth_token [None req-7e50b475-b056-4315-8d18-4ed80a66c18c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 07:54:47.467219 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561b855729c0 pid: 127589 (default app) Aug 24 07:55:24.187474 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=3 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:24.188591 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=3 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:24.189561 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=3 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:24.190289 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=3 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:24.746481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=3 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:24.747641 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=3 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:24.748572 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=3 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:24.755731 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=3 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:25.657805 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-2742ce04-3a0f-44ae-9189-b6bf07f22374 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] Action: 'create', calling method: .version_select at 0x7f320e1ee5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1869378167"}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:25.981297 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-3093a0f0-e95a-40fa-8649-c5255bf4a958 tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] Action: 'create', calling method: .version_select at 0x7f320e1ee5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1208024966", "metadata": {"Type": "work"}}} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:25.988790 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-3093a0f0-e95a-40fa-8649-c5255bf4a958 tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] Request method failure captured: Aug 24 07:55:25.988790 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 07:55:25.988790 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 07:55:25.988790 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 07:55:25.988790 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 07:55:25.988790 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 122 Aug 24 07:55:25.988790 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 07:55:25.988790 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 07:55:25.988790 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 07:55:25.988790 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 07:55:25.988790 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdlsWBALv5nh67GfUdcwA10rCNHsxf1cYOctCmqSCNpNeCPHe6Cs7blVlbB2XAdEMwGKgb69Rt0_yzHdOfbWnPiBc_z7s9m_lKflxjqQG6zWqRCWxzXdS8ltt3m3SwGJrZ3bfFyFXI0qISdX_W-pY1r1FG63s3VlP3Jt4YmvIoU0YYI Aug 24 07:55:25.988790 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 07:55:25.988790 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 07:55:25.988790 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 07:55:25.988790 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 07:55:25.988790 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 07:55:25.988790 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 07:55:25.988790 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: 728d1256cb6141a197dcfc82d7847e67 Aug 24 07:55:25.988790 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-VolumesNegativeTest-47498057 Aug 24 07:55:25.988790 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 07:55:25.988790 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 07:55:25.990240 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_728d1256cb6141a197dcfc82d7847e67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/728d1256cb6141a197dcfc82d7847e67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/728d1256cb6141a197dcfc82d7847e67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/728d1256cb6141a197dcfc82d7847e67"}]}] Aug 24 07:55:25.990240 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-VolumesNegativeTest-47498057 Aug 24 07:55:25.990240 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: 728d1256cb6141a197dcfc82d7847e67 Aug 24 07:55:25.990240 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-VolumesNegativeTest-47498057 Aug 24 07:55:25.990240 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-VolumesNegativeTest-47498057-project Aug 24 07:55:25.990240 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 07:55:25.990240 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 07:55:25.990240 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 7131191c2bf642bb9c698d6d740d5cff Aug 24 07:55:25.990240 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-VolumesNegativeTest-47498057-project Aug 24 07:55:25.990240 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Aug 24 07:55:25.990240 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1208024966", "metadata": {"Type": "work"}}} Aug 24 07:55:25.990240 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: Aug 24 07:55:25.990240 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 07:55:25.991087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1208024966', 'metadata': {'Type': 'work'}}}} Aug 24 07:55:25.991087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:55:25.991087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:25.991087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 07:55:25.991087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 07:55:25.991087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 07:55:25.991087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise error Aug 24 07:55:25.991087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 07:55:25.991087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:25.991087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 07:55:25.991087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 07:55:25.991087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:25.991087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 07:55:25.991087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 07:55:25.991087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:25.991087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:25.991087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:25.991087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:25.991087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:55:25.991087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:55:25.991087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:55:25.991087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:55:25.992520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 07:55:25.992520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 07:55:25.992520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:55:25.992520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:55:25.992520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 07:55:25.992520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 07:55:25.992520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 07:55:25.992520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 07:55:25.992520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 07:55:25.992520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 07:55:25.992520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 07:55:25.992520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:25.992520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:25.992520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:25.992520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:25.992520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:55:25.992520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:55:25.992520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 07:55:25.992520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 07:55:25.993918 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 07:55:25.993918 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:25.993918 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-3093a0f0-e95a-40fa-8649-c5255bf4a958 tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:55:25.993918 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-3093a0f0-e95a-40fa-8649-c5255bf4a958 tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.249144 Aug 24 07:55:25.993918 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 1/1] 10.222.0.72 () {60 vars in 1156 bytes} [Wed Aug 24 07:55:24 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1251 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 07:55:26.001723 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-0ee987ed-94b2-4274-a3dd-e4e2f0f9ea8b tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] Action: 'create', calling method: .version_select at 0x7f320e1ee670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1262971327", "metadata": {"Type": "work"}}} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:26.006470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-0ee987ed-94b2-4274-a3dd-e4e2f0f9ea8b tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] Request method failure captured: Aug 24 07:55:26.006470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 07:55:26.006470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 07:55:26.006470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 07:55:26.006470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 07:55:26.006470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 120 Aug 24 07:55:26.006470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 07:55:26.006470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 07:55:26.006470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 07:55:26.006470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 07:55:26.006470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdlsWBALv5nh67GfUdcwA10rCNHsxf1cYOctCmqSCNpNeCPHe6Cs7blVlbB2XAdEMwGKgb69Rt0_yzHdOfbWnPiBc_z7s9m_lKflxjqQG6zWqRCWxzXdS8ltt3m3SwGJrZ3bfFyFXI0qISdX_W-pY1r1FG63s3VlP3Jt4YmvIoU0YYI Aug 24 07:55:26.006470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 07:55:26.006470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 07:55:26.006470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 07:55:26.006470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 07:55:26.006470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 07:55:26.006470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 07:55:26.006470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: 728d1256cb6141a197dcfc82d7847e67 Aug 24 07:55:26.006470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-VolumesNegativeTest-47498057 Aug 24 07:55:26.006470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 07:55:26.006470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 07:55:26.008037 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_728d1256cb6141a197dcfc82d7847e67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/728d1256cb6141a197dcfc82d7847e67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/728d1256cb6141a197dcfc82d7847e67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/728d1256cb6141a197dcfc82d7847e67"}]}] Aug 24 07:55:26.008037 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-VolumesNegativeTest-47498057 Aug 24 07:55:26.008037 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: 728d1256cb6141a197dcfc82d7847e67 Aug 24 07:55:26.008037 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-VolumesNegativeTest-47498057 Aug 24 07:55:26.008037 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-VolumesNegativeTest-47498057-project Aug 24 07:55:26.008037 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 07:55:26.008037 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 07:55:26.008037 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 7131191c2bf642bb9c698d6d740d5cff Aug 24 07:55:26.008037 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-VolumesNegativeTest-47498057-project Aug 24 07:55:26.008037 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Aug 24 07:55:26.008037 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1262971327", "metadata": {"Type": "work"}}} Aug 24 07:55:26.008037 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: Aug 24 07:55:26.008037 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 07:55:26.009388 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1262971327', 'metadata': {'Type': 'work'}}}} Aug 24 07:55:26.009388 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:55:26.009388 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:26.009388 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 07:55:26.009388 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 07:55:26.009388 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 07:55:26.009388 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise error Aug 24 07:55:26.009388 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 07:55:26.009388 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:26.009388 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 07:55:26.009388 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 07:55:26.009388 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:26.009388 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 07:55:26.009388 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi '0' Aug 24 07:55:26.009388 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:26.009388 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:26.009388 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:26.009388 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:26.009388 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:55:26.009388 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:55:26.009388 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:55:26.009388 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:55:26.011012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 07:55:26.011012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 07:55:26.011012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:55:26.011012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:55:26.011012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 07:55:26.011012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 07:55:26.011012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 07:55:26.011012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 07:55:26.011012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 07:55:26.011012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 07:55:26.011012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 07:55:26.011012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:26.011012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:26.011012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:26.011012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:26.011012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:55:26.011012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:55:26.011012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 07:55:26.011012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 07:55:26.012592 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 07:55:26.012592 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:26.012592 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-0ee987ed-94b2-4274-a3dd-e4e2f0f9ea8b tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:55:26.012592 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-0ee987ed-94b2-4274-a3dd-e4e2f0f9ea8b tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011340 Aug 24 07:55:26.012592 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 2/2] 10.222.0.72 () {60 vars in 1156 bytes} [Wed Aug 24 07:55:25 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 07:55:26.023158 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-d80c1ab9-a47b-4cc6-851b-4386f8a2c6eb tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] Action: 'create', calling method: .version_select at 0x7f320e1281f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-793611668", "metadata": {"Type": "work"}}} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:26.041432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-d80c1ab9-a47b-4cc6-851b-4386f8a2c6eb tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] Request method failure captured: Aug 24 07:55:26.041432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 07:55:26.041432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 07:55:26.041432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 07:55:26.041432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 07:55:26.041432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 118 Aug 24 07:55:26.041432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 07:55:26.041432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 07:55:26.041432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 07:55:26.041432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 07:55:26.041432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdlsWBALv5nh67GfUdcwA10rCNHsxf1cYOctCmqSCNpNeCPHe6Cs7blVlbB2XAdEMwGKgb69Rt0_yzHdOfbWnPiBc_z7s9m_lKflxjqQG6zWqRCWxzXdS8ltt3m3SwGJrZ3bfFyFXI0qISdX_W-pY1r1FG63s3VlP3Jt4YmvIoU0YYI Aug 24 07:55:26.041432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 07:55:26.041432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 07:55:26.041432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 07:55:26.041432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 07:55:26.041432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 07:55:26.041432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 07:55:26.041432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: 728d1256cb6141a197dcfc82d7847e67 Aug 24 07:55:26.041432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-VolumesNegativeTest-47498057 Aug 24 07:55:26.041432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 07:55:26.041432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 07:55:26.042922 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_728d1256cb6141a197dcfc82d7847e67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/728d1256cb6141a197dcfc82d7847e67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/728d1256cb6141a197dcfc82d7847e67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/728d1256cb6141a197dcfc82d7847e67"}]}] Aug 24 07:55:26.042922 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-VolumesNegativeTest-47498057 Aug 24 07:55:26.042922 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: 728d1256cb6141a197dcfc82d7847e67 Aug 24 07:55:26.042922 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-VolumesNegativeTest-47498057 Aug 24 07:55:26.042922 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-VolumesNegativeTest-47498057-project Aug 24 07:55:26.042922 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 07:55:26.042922 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 07:55:26.042922 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 7131191c2bf642bb9c698d6d740d5cff Aug 24 07:55:26.042922 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-VolumesNegativeTest-47498057-project Aug 24 07:55:26.042922 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Aug 24 07:55:26.042922 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-793611668", "metadata": {"Type": "work"}}} Aug 24 07:55:26.042922 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: Aug 24 07:55:26.042922 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 07:55:26.043893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-793611668', 'metadata': {'Type': 'work'}}}} Aug 24 07:55:26.043893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:55:26.043893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:26.043893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 07:55:26.043893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 07:55:26.043893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 07:55:26.043893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise error Aug 24 07:55:26.043893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 07:55:26.043893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:26.043893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 07:55:26.043893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 07:55:26.043893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:26.043893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 07:55:26.043893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi '' Aug 24 07:55:26.043893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:26.043893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:26.043893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:26.043893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:26.043893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:55:26.043893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:55:26.043893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:55:26.043893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:55:26.045536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 07:55:26.045536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 07:55:26.045536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:55:26.045536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:55:26.045536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 07:55:26.045536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 07:55:26.045536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 07:55:26.045536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 07:55:26.045536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 07:55:26.045536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 07:55:26.045536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 07:55:26.045536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:26.045536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:26.045536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:26.045536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:26.045536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:55:26.045536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:55:26.045536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 07:55:26.045536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 07:55:26.048278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 07:55:26.048278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:26.048278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-d80c1ab9-a47b-4cc6-851b-4386f8a2c6eb tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:55:26.048278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-d80c1ab9-a47b-4cc6-851b-4386f8a2c6eb tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024844 Aug 24 07:55:26.048278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 3/3] 10.222.0.72 () {60 vars in 1156 bytes} [Wed Aug 24 07:55:26 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 07:55:26.059945 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-1eb9c06c-0155-4149-abf7-a1dd200370a0 tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] Calling method '.version_select at 0x7f320e128b80>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:26.988064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-1eb9c06c-0155-4149-abf7-a1dd200370a0 tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] HTTP exception thrown: Volume tempest-invalid-523067804 could not be found. Aug 24 07:55:26.992049 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-1eb9c06c-0155-4149-abf7-a1dd200370a0 tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] Request method failure captured: Aug 24 07:55:26.992049 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-523067804 HTTP/1.1 Aug 24 07:55:26.992049 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 07:55:26.992049 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 07:55:26.992049 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 07:55:26.992049 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 07:55:26.992049 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 07:55:26.992049 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 07:55:26.992049 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 07:55:26.992049 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 07:55:26.992049 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdlsWBALv5nh67GfUdcwA10rCNHsxf1cYOctCmqSCNpNeCPHe6Cs7blVlbB2XAdEMwGKgb69Rt0_yzHdOfbWnPiBc_z7s9m_lKflxjqQG6zWqRCWxzXdS8ltt3m3SwGJrZ3bfFyFXI0qISdX_W-pY1r1FG63s3VlP3Jt4YmvIoU0YYI Aug 24 07:55:26.992049 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 07:55:26.992049 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 07:55:26.992049 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 07:55:26.992049 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 07:55:26.992049 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 07:55:26.992049 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 07:55:26.992049 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: 728d1256cb6141a197dcfc82d7847e67 Aug 24 07:55:26.992049 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-VolumesNegativeTest-47498057 Aug 24 07:55:26.992049 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 07:55:26.992049 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 07:55:26.993706 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_728d1256cb6141a197dcfc82d7847e67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/728d1256cb6141a197dcfc82d7847e67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/728d1256cb6141a197dcfc82d7847e67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/728d1256cb6141a197dcfc82d7847e67"}]}] Aug 24 07:55:26.993706 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-VolumesNegativeTest-47498057 Aug 24 07:55:26.993706 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: 728d1256cb6141a197dcfc82d7847e67 Aug 24 07:55:26.993706 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-VolumesNegativeTest-47498057 Aug 24 07:55:26.993706 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-VolumesNegativeTest-47498057-project Aug 24 07:55:26.993706 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 07:55:26.993706 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 07:55:26.993706 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 7131191c2bf642bb9c698d6d740d5cff Aug 24 07:55:26.993706 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-VolumesNegativeTest-47498057-project Aug 24 07:55:26.993706 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: Aug 24 07:55:26.993706 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Volume tempest-invalid-523067804 could not be found. Aug 24 07:55:26.993706 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': 'tempest-invalid-523067804'} Aug 24 07:55:26.993706 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:55:26.994617 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:26.994617 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:55:26.994617 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:55:26.994617 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 07:55:26.994617 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 07:55:26.994617 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 07:55:26.994617 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 07:55:26.994617 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 07:55:26.994617 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 07:55:26.994617 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 07:55:26.994617 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 07:55:26.994617 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:55:26.994617 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:55:26.994617 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:55:26.994617 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:55:26.994617 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-523067804 could not be found. (HTTP 404) (Request-ID: req-9a6c5f77-ba8a-4a46-92a1-d6e5d9b0b239) Aug 24 07:55:26.994617 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:26.994617 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:26.994617 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:26.995973 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:26.995973 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 07:55:26.995973 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 07:55:26.995973 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 07:55:26.995973 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 07:55:26.995973 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 07:55:26.995973 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 07:55:26.995973 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 07:55:26.995973 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 07:55:26.995973 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:55:26.995973 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:55:26.995973 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 07:55:26.995973 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 07:55:26.995973 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 07:55:26.995973 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 07:55:26.995973 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 07:55:26.995973 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 07:55:26.995973 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 07:55:26.995973 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 07:55:26.997921 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:55:26.997921 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:55:26.997921 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:55:26.997921 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:55:26.997921 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-523067804 could not be found. Aug 24 07:55:26.997921 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:26.997921 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:26.997921 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:26.997921 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:26.997921 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:55:26.997921 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:55:26.997921 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:55:26.997921 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:55:26.997921 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 07:55:26.997921 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 07:55:26.997921 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:55:26.997921 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:55:26.997921 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 07:55:26.997921 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:55:26.997921 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-523067804 could not be found. Aug 24 07:55:27.000723 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:27.000723 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:27.000723 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:27.000723 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:27.000723 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:55:27.000723 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:55:27.000723 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:55:27.000723 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:55:27.000723 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-523067804 could not be found. Aug 24 07:55:27.000723 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:27.000723 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-1eb9c06c-0155-4149-abf7-a1dd200370a0 tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] Returning 404 to user: Volume tempest-invalid-523067804 could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:55:27.000723 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-1eb9c06c-0155-4149-abf7-a1dd200370a0 tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/tempest-invalid-523067804" status: 404 len: 98 microversion: 2.1 time: 0.945703 Aug 24 07:55:27.000723 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 4/4] 10.222.0.72 () {58 vars in 1215 bytes} [Wed Aug 24 07:55:26 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-523067804 => generated 98 bytes in 951 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 07:55:27.009746 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-0827f345-24fe-45cf-a245-83347f261ac0 tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005298 Aug 24 07:55:27.011156 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 5/5] 10.222.0.72 () {58 vars in 1140 bytes} [Wed Aug 24 07:55:27 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 24 07:55:27.023456 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-132fb644-d6b2-47e5-a741-6d7a97ab257f tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007600 Aug 24 07:55:27.025212 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 6/6] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 24 07:55:27 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 24 07:55:27.035266 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-fa74307f-0b27-454e-94a6-aee845a9f193 tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] Calling method '.version_select at 0x7f320e060550>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:27.671510 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-fa74307f-0b27-454e-94a6-aee845a9f193 tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] HTTP exception thrown: Volume def1350d-17a3-4886-9ad9-e62a52c66422 could not be found. Aug 24 07:55:27.673826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-fa74307f-0b27-454e-94a6-aee845a9f193 tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] Request method failure captured: Aug 24 07:55:27.673826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: DELETE /compute/v2.1/os-volumes/def1350d-17a3-4886-9ad9-e62a52c66422 HTTP/1.1 Aug 24 07:55:27.673826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 07:55:27.673826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 07:55:27.673826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 07:55:27.673826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 07:55:27.673826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 07:55:27.673826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 07:55:27.673826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 07:55:27.673826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 07:55:27.673826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdlsWBALv5nh67GfUdcwA10rCNHsxf1cYOctCmqSCNpNeCPHe6Cs7blVlbB2XAdEMwGKgb69Rt0_yzHdOfbWnPiBc_z7s9m_lKflxjqQG6zWqRCWxzXdS8ltt3m3SwGJrZ3bfFyFXI0qISdX_W-pY1r1FG63s3VlP3Jt4YmvIoU0YYI Aug 24 07:55:27.673826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 07:55:27.673826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 07:55:27.673826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 07:55:27.673826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 07:55:27.673826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 07:55:27.673826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 07:55:27.673826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: 728d1256cb6141a197dcfc82d7847e67 Aug 24 07:55:27.673826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-VolumesNegativeTest-47498057 Aug 24 07:55:27.673826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 07:55:27.673826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 07:55:27.674987 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_728d1256cb6141a197dcfc82d7847e67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/728d1256cb6141a197dcfc82d7847e67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/728d1256cb6141a197dcfc82d7847e67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/728d1256cb6141a197dcfc82d7847e67"}]}] Aug 24 07:55:27.674987 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-VolumesNegativeTest-47498057 Aug 24 07:55:27.674987 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: 728d1256cb6141a197dcfc82d7847e67 Aug 24 07:55:27.674987 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-VolumesNegativeTest-47498057 Aug 24 07:55:27.674987 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-VolumesNegativeTest-47498057-project Aug 24 07:55:27.674987 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 07:55:27.674987 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 07:55:27.674987 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 7131191c2bf642bb9c698d6d740d5cff Aug 24 07:55:27.674987 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-VolumesNegativeTest-47498057-project Aug 24 07:55:27.674987 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: Aug 24 07:55:27.674987 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Volume def1350d-17a3-4886-9ad9-e62a52c66422 could not be found. Aug 24 07:55:27.674987 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': 'def1350d-17a3-4886-9ad9-e62a52c66422'} Aug 24 07:55:27.674987 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:55:27.675687 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:27.675687 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:55:27.675687 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:55:27.675687 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 07:55:27.675687 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 07:55:27.675687 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 07:55:27.675687 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 07:55:27.675687 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 07:55:27.675687 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 07:55:27.675687 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 07:55:27.675687 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 07:55:27.675687 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:55:27.675687 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:55:27.675687 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:55:27.675687 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:55:27.675687 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume def1350d-17a3-4886-9ad9-e62a52c66422 could not be found. (HTTP 404) (Request-ID: req-0875f223-4cff-4589-9e3c-fdfad592d99c) Aug 24 07:55:27.675687 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:27.675687 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:27.675687 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:27.678980 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:27.678980 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 07:55:27.678980 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 07:55:27.678980 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 07:55:27.678980 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 07:55:27.678980 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 07:55:27.678980 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 07:55:27.678980 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 07:55:27.678980 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 07:55:27.678980 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:55:27.678980 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:55:27.678980 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 07:55:27.678980 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 07:55:27.678980 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 07:55:27.678980 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 07:55:27.678980 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 07:55:27.678980 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 07:55:27.678980 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 07:55:27.678980 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 07:55:27.680038 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:55:27.680038 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:55:27.680038 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:55:27.680038 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:55:27.680038 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume def1350d-17a3-4886-9ad9-e62a52c66422 could not be found. Aug 24 07:55:27.680038 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:27.680038 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:27.680038 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:27.680038 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:27.680038 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:55:27.680038 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:55:27.680038 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:55:27.680038 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:55:27.680038 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 07:55:27.680038 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 07:55:27.680038 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:55:27.680038 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:55:27.680038 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 07:55:27.680038 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:55:27.681092 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume def1350d-17a3-4886-9ad9-e62a52c66422 could not be found. Aug 24 07:55:27.681092 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:27.681092 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:27.681092 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:27.681092 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:27.681092 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:55:27.681092 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:55:27.681092 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:55:27.681092 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:55:27.681092 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume def1350d-17a3-4886-9ad9-e62a52c66422 could not be found. Aug 24 07:55:27.681092 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:27.684045 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-fa74307f-0b27-454e-94a6-aee845a9f193 tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] Returning 404 to user: Volume def1350d-17a3-4886-9ad9-e62a52c66422 could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:55:27.685391 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-fa74307f-0b27-454e-94a6-aee845a9f193 tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/def1350d-17a3-4886-9ad9-e62a52c66422" status: 404 len: 109 microversion: 2.1 time: 0.655199 Aug 24 07:55:27.686479 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 7/7] 10.222.0.72 () {58 vars in 1248 bytes} [Wed Aug 24 07:55:27 2022] DELETE /compute/v2.1/os-volumes/def1350d-17a3-4886-9ad9-e62a52c66422 => generated 109 bytes in 657 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 07:55:27.701336 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e5352651-020f-44f0-8c80-730a6aa7c8ed tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] Calling method '.version_select at 0x7f320e060820>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:27.978225 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-2742ce04-3a0f-44ae-9189-b6bf07f22374 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.802827 Aug 24 07:55:27.979017 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 1/8] 10.222.0.72 () {60 vars in 1155 bytes} [Wed Aug 24 07:55:24 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3807 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 07:55:27.999013 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-313f0917-0f12-4c08-b1a0-e6f026495536 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] Calling method '.version_select at 0x7f320e0c34c0>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:28.000220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-e5352651-020f-44f0-8c80-730a6aa7c8ed tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] HTTP exception thrown: Volume c2ef4185-3b15-4259-8d97-d94d534983d2 could not be found. Aug 24 07:55:28.002448 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e5352651-020f-44f0-8c80-730a6aa7c8ed tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] Request method failure captured: Aug 24 07:55:28.002448 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: GET /compute/v2.1/os-volumes/c2ef4185-3b15-4259-8d97-d94d534983d2 HTTP/1.1 Aug 24 07:55:28.002448 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 07:55:28.002448 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 07:55:28.002448 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 07:55:28.002448 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 07:55:28.002448 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 07:55:28.002448 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 07:55:28.002448 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 07:55:28.002448 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 07:55:28.002448 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdlsWBALv5nh67GfUdcwA10rCNHsxf1cYOctCmqSCNpNeCPHe6Cs7blVlbB2XAdEMwGKgb69Rt0_yzHdOfbWnPiBc_z7s9m_lKflxjqQG6zWqRCWxzXdS8ltt3m3SwGJrZ3bfFyFXI0qISdX_W-pY1r1FG63s3VlP3Jt4YmvIoU0YYI Aug 24 07:55:28.002448 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 07:55:28.002448 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 07:55:28.002448 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 07:55:28.002448 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 07:55:28.002448 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 07:55:28.002448 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 07:55:28.002448 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: 728d1256cb6141a197dcfc82d7847e67 Aug 24 07:55:28.002448 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-VolumesNegativeTest-47498057 Aug 24 07:55:28.002448 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 07:55:28.002448 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 07:55:28.003621 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_728d1256cb6141a197dcfc82d7847e67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/728d1256cb6141a197dcfc82d7847e67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/728d1256cb6141a197dcfc82d7847e67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/728d1256cb6141a197dcfc82d7847e67"}]}] Aug 24 07:55:28.003621 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-VolumesNegativeTest-47498057 Aug 24 07:55:28.003621 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: 728d1256cb6141a197dcfc82d7847e67 Aug 24 07:55:28.003621 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-VolumesNegativeTest-47498057 Aug 24 07:55:28.003621 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-VolumesNegativeTest-47498057-project Aug 24 07:55:28.003621 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 07:55:28.003621 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 07:55:28.003621 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 7131191c2bf642bb9c698d6d740d5cff Aug 24 07:55:28.003621 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-VolumesNegativeTest-47498057-project Aug 24 07:55:28.003621 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: Aug 24 07:55:28.003621 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Volume c2ef4185-3b15-4259-8d97-d94d534983d2 could not be found. Aug 24 07:55:28.003621 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': 'c2ef4185-3b15-4259-8d97-d94d534983d2'} Aug 24 07:55:28.003621 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:55:28.004315 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:28.004315 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:55:28.004315 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:55:28.004315 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 07:55:28.004315 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 07:55:28.004315 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 07:55:28.004315 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 07:55:28.004315 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 07:55:28.004315 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 07:55:28.004315 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 07:55:28.004315 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 07:55:28.004315 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:55:28.004315 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:55:28.004315 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:55:28.004315 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:55:28.004315 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c2ef4185-3b15-4259-8d97-d94d534983d2 could not be found. (HTTP 404) (Request-ID: req-43aa31db-275c-402c-a65c-4bf99b10109b) Aug 24 07:55:28.004315 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:28.004315 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:28.004315 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:28.005363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:28.005363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 07:55:28.005363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 07:55:28.005363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 07:55:28.005363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 07:55:28.005363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 07:55:28.005363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 07:55:28.005363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 07:55:28.005363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 07:55:28.005363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:55:28.005363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:55:28.005363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 07:55:28.005363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 07:55:28.005363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 07:55:28.005363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 07:55:28.005363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 07:55:28.005363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 07:55:28.005363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 07:55:28.005363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 07:55:28.006350 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:55:28.006350 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:55:28.006350 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:55:28.006350 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:55:28.006350 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c2ef4185-3b15-4259-8d97-d94d534983d2 could not be found. Aug 24 07:55:28.006350 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:28.006350 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:28.006350 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:28.006350 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:28.006350 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:55:28.006350 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:55:28.006350 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:55:28.006350 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:55:28.006350 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 07:55:28.006350 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 07:55:28.006350 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:55:28.006350 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:55:28.006350 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 07:55:28.006350 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:55:28.007565 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c2ef4185-3b15-4259-8d97-d94d534983d2 could not be found. Aug 24 07:55:28.007565 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:28.007565 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:28.007565 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:28.007565 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:28.007565 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:55:28.007565 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:55:28.007565 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:55:28.007565 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:55:28.007565 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c2ef4185-3b15-4259-8d97-d94d534983d2 could not be found. Aug 24 07:55:28.007565 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:28.007565 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e5352651-020f-44f0-8c80-730a6aa7c8ed tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] Returning 404 to user: Volume c2ef4185-3b15-4259-8d97-d94d534983d2 could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:55:28.007565 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-e5352651-020f-44f0-8c80-730a6aa7c8ed tempest-VolumesNegativeTest-47498057 tempest-VolumesNegativeTest-47498057-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/c2ef4185-3b15-4259-8d97-d94d534983d2" status: 404 len: 109 microversion: 2.1 time: 0.311389 Aug 24 07:55:28.014527 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 8/9] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 24 07:55:27 2022] GET /compute/v2.1/os-volumes/c2ef4185-3b15-4259-8d97-d94d534983d2 => generated 109 bytes in 323 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 07:55:28.353588 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-313f0917-0f12-4c08-b1a0-e6f026495536 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/b827b480-f7d5-41c4-9806-2a930df64ec1" status: 200 len: 345 microversion: 2.1 time: 0.363722 Aug 24 07:55:28.361099 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 2/10] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 24 07:55:27 2022] GET /compute/v2.1/os-volumes/b827b480-f7d5-41c4-9806-2a930df64ec1 => generated 345 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:55:29.371724 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-6da5f642-0098-4bc5-af72-9974f9c3e8ec tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] Calling method '.version_select at 0x7f320e128ee0>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:29.463911 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-6da5f642-0098-4bc5-af72-9974f9c3e8ec tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/b827b480-f7d5-41c4-9806-2a930df64ec1" status: 200 len: 346 microversion: 2.1 time: 0.100240 Aug 24 07:55:29.464749 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 9/11] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 24 07:55:29 2022] GET /compute/v2.1/os-volumes/b827b480-f7d5-41c4-9806-2a930df64ec1 => generated 346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:55:29.479621 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-78d1f1d2-f1db-417f-bbd6-99ab63ec1a7b tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] Action: 'create', calling method: .version_select at 0x7f320e0c3af0>, body: {"snapshot": {"volume_id": "b827b480-f7d5-41c4-9806-2a930df64ec1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-803237406"}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:30.516125 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-78d1f1d2-f1db-417f-bbd6-99ab63ec1a7b tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] 10.222.0.72 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.042188 Aug 24 07:55:30.517392 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 3/12] 10.222.0.72 () {60 vars in 1162 bytes} [Wed Aug 24 07:55:29 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:55:30.529093 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-bd056823-578d-4735-9404-d0e15c175e06 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] Calling method '.version_select at 0x7f320e060af0>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:30.784047 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-bd056823-578d-4735-9404-d0e15c175e06 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/0248652c-cf94-410b-8a1e-dd3c76842fe2" status: 200 len: 286 microversion: 2.1 time: 0.259925 Aug 24 07:55:30.785220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 10/13] 10.222.0.72 () {58 vars in 1251 bytes} [Wed Aug 24 07:55:30 2022] GET /compute/v2.1/os-snapshots/0248652c-cf94-410b-8a1e-dd3c76842fe2 => generated 286 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:55:30.795873 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-d7a7856c-eb26-428f-8795-8f6e2de7138d tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] Calling method '.version_select at 0x7f320e0d6ca0>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:31.179949 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-d7a7856c-eb26-428f-8795-8f6e2de7138d tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.387822 Aug 24 07:55:31.180527 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 4/14] 10.222.0.72 () {58 vars in 1140 bytes} [Wed Aug 24 07:55:30 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:55:31.192196 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-5c0ecd1b-352b-407a-93fc-371e0cf32803 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] Calling method '.version_select at 0x7f320e060c10>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:31.765966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-5c0ecd1b-352b-407a-93fc-371e0cf32803 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/0248652c-cf94-410b-8a1e-dd3c76842fe2" status: 200 len: 286 microversion: 2.1 time: 0.570434 Aug 24 07:55:31.765966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 11/15] 10.222.0.72 () {58 vars in 1251 bytes} [Wed Aug 24 07:55:31 2022] GET /compute/v2.1/os-snapshots/0248652c-cf94-410b-8a1e-dd3c76842fe2 => generated 286 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:55:32.775893 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-d5333433-7a18-4ea0-b540-c7f715eedf49 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] Calling method '.version_select at 0x7f320e0c3b80>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:32.917096 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-d5333433-7a18-4ea0-b540-c7f715eedf49 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/0248652c-cf94-410b-8a1e-dd3c76842fe2" status: 200 len: 286 microversion: 2.1 time: 0.144949 Aug 24 07:55:32.920675 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 5/16] 10.222.0.72 () {58 vars in 1251 bytes} [Wed Aug 24 07:55:32 2022] GET /compute/v2.1/os-snapshots/0248652c-cf94-410b-8a1e-dd3c76842fe2 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:55:33.929983 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-6c439096-7152-4a23-914d-1389828d9eb9 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] Calling method '.version_select at 0x7f320e061280>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:33.969684 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-6c439096-7152-4a23-914d-1389828d9eb9 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/0248652c-cf94-410b-8a1e-dd3c76842fe2" status: 200 len: 286 microversion: 2.1 time: 0.041869 Aug 24 07:55:33.969684 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 12/17] 10.222.0.72 () {58 vars in 1251 bytes} [Wed Aug 24 07:55:33 2022] GET /compute/v2.1/os-snapshots/0248652c-cf94-410b-8a1e-dd3c76842fe2 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:55:34.983678 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-1977206e-0e1b-4588-9979-223e9a256f7e tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] Calling method '.version_select at 0x7f320e0c3820>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:35.112743 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-1977206e-0e1b-4588-9979-223e9a256f7e tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/0248652c-cf94-410b-8a1e-dd3c76842fe2" status: 200 len: 287 microversion: 2.1 time: 0.133078 Aug 24 07:55:35.113193 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 6/18] 10.222.0.72 () {58 vars in 1251 bytes} [Wed Aug 24 07:55:34 2022] GET /compute/v2.1/os-snapshots/0248652c-cf94-410b-8a1e-dd3c76842fe2 => generated 287 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:55:35.130191 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-79a7a45d-c2bb-49fc-9950-f868556469ab tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] Calling method '.version_select at 0x7f320e060430>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:35.406004 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-79a7a45d-c2bb-49fc-9950-f868556469ab tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] 10.222.0.72 "DELETE /compute/v2.1/os-snapshots/0248652c-cf94-410b-8a1e-dd3c76842fe2" status: 202 len: 0 microversion: 2.1 time: 0.279434 Aug 24 07:55:35.407411 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 13/19] 10.222.0.72 () {58 vars in 1254 bytes} [Wed Aug 24 07:55:35 2022] DELETE /compute/v2.1/os-snapshots/0248652c-cf94-410b-8a1e-dd3c76842fe2 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:55:35.419136 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b22c37bf-560d-4eec-b8a8-232e2df9fb22 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] Calling method '.version_select at 0x7f320e0ab940>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:35.642458 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-9e6fc358-0776-4e94-aa8b-491f0d952016 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Action: 'create', calling method: .version_select at 0x7f320e1eeee0>, body: {"keypair": {"name": "tempest-keypair-1678806733", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpvO/V02pSbi4ctGhsaSps5UgFGkJJolr1yqZaGxPu8FhJlgaMCJMYHVwcPsNrwEv4L6Bc3FMqkEZz8BshXD+xZTZJ/Yqq1+rjN5QHsGz53/p+w5CzJRor91gOecTDFlA=="}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:35.661680 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-b22c37bf-560d-4eec-b8a8-232e2df9fb22 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/0248652c-cf94-410b-8a1e-dd3c76842fe2" status: 200 len: 286 microversion: 2.1 time: 0.249912 Aug 24 07:55:35.668064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 14/20] 10.222.0.72 () {58 vars in 1251 bytes} [Wed Aug 24 07:55:35 2022] GET /compute/v2.1/os-snapshots/0248652c-cf94-410b-8a1e-dd3c76842fe2 => generated 286 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:55:35.765739 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-9e6fc358-0776-4e94-aa8b-491f0d952016 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Getting quotas for project 27c8e372420a4076b855d46a4f8ff521. Resources: {'key_pairs'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:55:35.785774 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-9e6fc358-0776-4e94-aa8b-491f0d952016 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Getting quotas for user d318793a5fee43bdb1a043b30396884b and project 27c8e372420a4076b855d46a4f8ff521. Resources: {'key_pairs'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:55:35.962962 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-9e6fc358-0776-4e94-aa8b-491f0d952016 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.754362 Aug 24 07:55:35.970651 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 7/21] 10.222.0.72 () {62 vars in 1200 bytes} [Wed Aug 24 07:55:35 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 763 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 07:55:36.681288 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-c6a970f5-e6aa-4ec5-a9bb-03fcac909c17 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] Calling method '.version_select at 0x7f320e128dc0>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:36.710168 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-c6a970f5-e6aa-4ec5-a9bb-03fcac909c17 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] HTTP exception thrown: Snapshot 0248652c-cf94-410b-8a1e-dd3c76842fe2 could not be found. Aug 24 07:55:36.713287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-c6a970f5-e6aa-4ec5-a9bb-03fcac909c17 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] Request method failure captured: Aug 24 07:55:36.713287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: GET /compute/v2.1/os-snapshots/0248652c-cf94-410b-8a1e-dd3c76842fe2 HTTP/1.1 Aug 24 07:55:36.713287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 07:55:36.713287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 07:55:36.713287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 07:55:36.713287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 07:55:36.713287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 07:55:36.713287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 07:55:36.713287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 07:55:36.713287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 07:55:36.713287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdlspteZQFk_-AiLBFkA1gTYuYnRSOAYHjfQcrwAvn7JWjcq4DQD4DG33HWvVnp-D24Wb27jvwp1NLkIUOg1uC2ZNYvPGK78pUfoxFG8LtAkatRIipf1qoalOmaT-6f9Gc-8qqp7lYg8CMwMBWDnun2s4pKNSO_R9Gt-VnK6Y5mHNlU Aug 24 07:55:36.713287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 07:55:36.713287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 07:55:36.713287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 07:55:36.713287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 07:55:36.713287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 07:55:36.713287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 07:55:36.713287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: 5b00b496a30043b093f29a81fc0694c3 Aug 24 07:55:36.713287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1985466249 Aug 24 07:55:36.713287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 07:55:36.713287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 07:55:36.714488 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_5b00b496a30043b093f29a81fc0694c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/5b00b496a30043b093f29a81fc0694c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5b00b496a30043b093f29a81fc0694c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5b00b496a30043b093f29a81fc0694c3"}]}] Aug 24 07:55:36.714488 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1985466249 Aug 24 07:55:36.714488 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: 5b00b496a30043b093f29a81fc0694c3 Aug 24 07:55:36.714488 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1985466249 Aug 24 07:55:36.714488 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-VolumesSnapshotsTestJSON-1985466249-project Aug 24 07:55:36.714488 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 07:55:36.714488 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 07:55:36.714488 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 8b63da4b987e41618280b19220ab6e04 Aug 24 07:55:36.714488 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1985466249-project Aug 24 07:55:36.714488 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: Aug 24 07:55:36.714488 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Snapshot 0248652c-cf94-410b-8a1e-dd3c76842fe2 could not be found. Aug 24 07:55:36.714488 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': '0248652c-cf94-410b-8a1e-dd3c76842fe2'} Aug 24 07:55:36.714488 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:55:36.715309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:36.715309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 07:55:36.715309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 07:55:36.715309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 07:55:36.715309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 07:55:36.715309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 07:55:36.715309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 07:55:36.715309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 07:55:36.715309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 07:55:36.715309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 07:55:36.715309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 07:55:36.715309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:55:36.715309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:55:36.715309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:55:36.715309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:55:36.715309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0248652c-cf94-410b-8a1e-dd3c76842fe2 could not be found. (HTTP 404) (Request-ID: req-7859fa9c-7391-4850-9d14-cd935b0a55d4) Aug 24 07:55:36.715309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:36.715309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:36.716157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:36.716157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:36.716157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 07:55:36.716157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 07:55:36.716157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 07:55:36.716157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 07:55:36.716157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 07:55:36.716157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 07:55:36.716157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 07:55:36.716157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 07:55:36.716157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 07:55:36.716157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 07:55:36.716157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 07:55:36.716157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 07:55:36.716157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 07:55:36.716157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 07:55:36.716157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 07:55:36.716157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 07:55:36.716157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 07:55:36.717069 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 07:55:36.717069 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:55:36.717069 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:55:36.717069 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:55:36.717069 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:55:36.717069 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0248652c-cf94-410b-8a1e-dd3c76842fe2 could not be found. Aug 24 07:55:36.717069 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:36.717069 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:36.717069 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:36.717069 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:36.717069 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:55:36.717069 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:55:36.717069 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:55:36.717069 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:55:36.717069 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 07:55:36.717069 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 07:55:36.717069 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:55:36.717069 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:55:36.717069 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 07:55:36.717069 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:55:36.718143 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0248652c-cf94-410b-8a1e-dd3c76842fe2 could not be found. Aug 24 07:55:36.718143 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:36.718143 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:36.718143 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:36.718143 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:36.718143 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:55:36.718143 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:55:36.718143 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:55:36.718143 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:55:36.718143 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0248652c-cf94-410b-8a1e-dd3c76842fe2 could not be found. Aug 24 07:55:36.718143 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:36.720315 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-c6a970f5-e6aa-4ec5-a9bb-03fcac909c17 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] Returning 404 to user: Snapshot 0248652c-cf94-410b-8a1e-dd3c76842fe2 could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:55:36.722139 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-c6a970f5-e6aa-4ec5-a9bb-03fcac909c17 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/0248652c-cf94-410b-8a1e-dd3c76842fe2" status: 404 len: 111 microversion: 2.1 time: 0.050327 Aug 24 07:55:36.723134 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 15/22] 10.222.0.72 () {58 vars in 1251 bytes} [Wed Aug 24 07:55:36 2022] GET /compute/v2.1/os-snapshots/0248652c-cf94-410b-8a1e-dd3c76842fe2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:55:36.733991 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-8fa14f5a-efea-4820-b533-e2b5c92dbe9a tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] Calling method '.version_select at 0x7f320e05d550>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:37.147504 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-8fa14f5a-efea-4820-b533-e2b5c92dbe9a tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/b827b480-f7d5-41c4-9806-2a930df64ec1" status: 202 len: 0 microversion: 2.1 time: 0.419868 Aug 24 07:55:37.149003 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 8/23] 10.222.0.72 () {58 vars in 1248 bytes} [Wed Aug 24 07:55:36 2022] DELETE /compute/v2.1/os-volumes/b827b480-f7d5-41c4-9806-2a930df64ec1 => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:55:37.162839 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-ba7042e3-c9c7-46cc-9b9c-dfc3e6a4529a tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] Calling method '.version_select at 0x7f320e0aba60>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:37.248108 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-ba7042e3-c9c7-46cc-9b9c-dfc3e6a4529a tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/b827b480-f7d5-41c4-9806-2a930df64ec1" status: 200 len: 345 microversion: 2.1 time: 0.095303 Aug 24 07:55:37.249651 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 16/24] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 24 07:55:37 2022] GET /compute/v2.1/os-volumes/b827b480-f7d5-41c4-9806-2a930df64ec1 => generated 345 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:55:38.265669 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-1b12b93a-93ae-4177-987b-042f80c14b07 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] Calling method '.version_select at 0x7f320e05db80>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:38.324233 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.wsgi [None req-1b12b93a-93ae-4177-987b-042f80c14b07 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] HTTP exception thrown: Volume b827b480-f7d5-41c4-9806-2a930df64ec1 could not be found. Aug 24 07:55:38.329502 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-1b12b93a-93ae-4177-987b-042f80c14b07 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] Request method failure captured: Aug 24 07:55:38.329502 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: request: GET /compute/v2.1/os-volumes/b827b480-f7d5-41c4-9806-2a930df64ec1 HTTP/1.1 Aug 24 07:55:38.329502 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept: application/json Aug 24 07:55:38.329502 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept-Encoding: identity Aug 24 07:55:38.329502 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Connection: close Aug 24 07:55:38.329502 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Length: 0 Aug 24 07:55:38.329502 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Type: application/json Aug 24 07:55:38.329502 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Host: 10.222.0.72 Aug 24 07:55:38.329502 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Openstack-System-Scope: None Aug 24 07:55:38.329502 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: User-Agent: python-urllib3/1.26.11 Aug 24 07:55:38.329502 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Auth-Token: gAAAAABjBdlspteZQFk_-AiLBFkA1gTYuYnRSOAYHjfQcrwAvn7JWjcq4DQD4DG33HWvVnp-D24Wb27jvwp1NLkIUOg1uC2ZNYvPGK78pUfoxFG8LtAkatRIipf1qoalOmaT-6f9Gc-8qqp7lYg8CMwMBWDnun2s4pKNSO_R9Gt-VnK6Y5mHNlU Aug 24 07:55:38.329502 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Id: None Aug 24 07:55:38.329502 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Name: None Aug 24 07:55:38.329502 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Identity-Status: Confirmed Aug 24 07:55:38.329502 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Is-Admin-Project: True Aug 24 07:55:38.329502 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Id: default Aug 24 07:55:38.329502 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Name: Default Aug 24 07:55:38.329502 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Id: 5b00b496a30043b093f29a81fc0694c3 Aug 24 07:55:38.329502 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1985466249 Aug 24 07:55:38.329502 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Role: reader,member Aug 24 07:55:38.329502 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Roles: reader,member Aug 24 07:55:38.331699 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_5b00b496a30043b093f29a81fc0694c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/5b00b496a30043b093f29a81fc0694c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5b00b496a30043b093f29a81fc0694c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5b00b496a30043b093f29a81fc0694c3"}]}] Aug 24 07:55:38.331699 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1985466249 Aug 24 07:55:38.331699 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Id: 5b00b496a30043b093f29a81fc0694c3 Aug 24 07:55:38.331699 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1985466249 Aug 24 07:55:38.331699 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User: tempest-VolumesSnapshotsTestJSON-1985466249-project Aug 24 07:55:38.331699 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Id: default Aug 24 07:55:38.331699 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Name: Default Aug 24 07:55:38.331699 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Id: 8b63da4b987e41618280b19220ab6e04 Aug 24 07:55:38.331699 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1985466249-project Aug 24 07:55:38.331699 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: method: Aug 24 07:55:38.331699 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: exception: Volume b827b480-f7d5-41c4-9806-2a930df64ec1 could not be found. Aug 24 07:55:38.331699 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: action_args: {'id': 'b827b480-f7d5-41c4-9806-2a930df64ec1'} Aug 24 07:55:38.331699 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:55:38.333050 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:38.333050 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:55:38.333050 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:55:38.333050 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 07:55:38.333050 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 07:55:38.333050 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 07:55:38.333050 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 07:55:38.333050 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 07:55:38.333050 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 07:55:38.333050 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 07:55:38.333050 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 07:55:38.333050 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:55:38.333050 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:55:38.333050 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:55:38.333050 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:55:38.333050 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b827b480-f7d5-41c4-9806-2a930df64ec1 could not be found. (HTTP 404) (Request-ID: req-95e977d9-8d19-45a9-87e1-62b83c5857d2) Aug 24 07:55:38.333050 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:55:38.333050 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:38.333050 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:55:38.335178 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:38.335178 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 07:55:38.335178 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 07:55:38.335178 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 07:55:38.335178 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 07:55:38.335178 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 07:55:38.335178 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 07:55:38.335178 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 07:55:38.335178 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 07:55:38.335178 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:55:38.335178 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:55:38.335178 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 07:55:38.335178 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 07:55:38.335178 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 07:55:38.335178 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 07:55:38.335178 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 07:55:38.335178 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 07:55:38.335178 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 07:55:38.335178 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 07:55:38.337227 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:55:38.337227 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:55:38.337227 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:55:38.337227 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:55:38.337227 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b827b480-f7d5-41c4-9806-2a930df64ec1 could not be found. Aug 24 07:55:38.337227 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:55:38.337227 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:38.337227 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:55:38.337227 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:38.337227 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:55:38.337227 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:55:38.337227 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:55:38.337227 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:55:38.337227 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 07:55:38.337227 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 07:55:38.337227 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:55:38.337227 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:55:38.337227 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 07:55:38.337227 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:55:38.339194 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b827b480-f7d5-41c4-9806-2a930df64ec1 could not be found. Aug 24 07:55:38.339194 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:55:38.339194 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:38.339194 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:55:38.339194 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:38.339194 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:55:38.339194 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:55:38.339194 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:55:38.339194 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:55:38.339194 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b827b480-f7d5-41c4-9806-2a930df64ec1 could not be found. Aug 24 07:55:38.339194 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:55:38.339194 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-1b12b93a-93ae-4177-987b-042f80c14b07 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] Returning 404 to user: Volume b827b480-f7d5-41c4-9806-2a930df64ec1 could not be found. {{(pid=127590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:55:38.339194 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-1b12b93a-93ae-4177-987b-042f80c14b07 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/b827b480-f7d5-41c4-9806-2a930df64ec1" status: 404 len: 109 microversion: 2.1 time: 0.074368 Aug 24 07:55:38.339194 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 9/25] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 24 07:55:38 2022] GET /compute/v2.1/os-volumes/b827b480-f7d5-41c4-9806-2a930df64ec1 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:55:38.350265 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-8973dbbb-58d9-438e-82f5-c21665544bea tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] Calling method '.version_select at 0x7f320e060430>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:38.495821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-8973dbbb-58d9-438e-82f5-c21665544bea tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] HTTP exception thrown: Volume b827b480-f7d5-41c4-9806-2a930df64ec1 could not be found. Aug 24 07:55:38.495821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-8973dbbb-58d9-438e-82f5-c21665544bea tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] Request method failure captured: Aug 24 07:55:38.495821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: DELETE /compute/v2.1/os-volumes/b827b480-f7d5-41c4-9806-2a930df64ec1 HTTP/1.1 Aug 24 07:55:38.495821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 07:55:38.495821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 07:55:38.495821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 07:55:38.495821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 07:55:38.495821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 07:55:38.495821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 07:55:38.495821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 07:55:38.495821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 07:55:38.495821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdlspteZQFk_-AiLBFkA1gTYuYnRSOAYHjfQcrwAvn7JWjcq4DQD4DG33HWvVnp-D24Wb27jvwp1NLkIUOg1uC2ZNYvPGK78pUfoxFG8LtAkatRIipf1qoalOmaT-6f9Gc-8qqp7lYg8CMwMBWDnun2s4pKNSO_R9Gt-VnK6Y5mHNlU Aug 24 07:55:38.495821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 07:55:38.495821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 07:55:38.495821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 07:55:38.495821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 07:55:38.495821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 07:55:38.495821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 07:55:38.495821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: 5b00b496a30043b093f29a81fc0694c3 Aug 24 07:55:38.495821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1985466249 Aug 24 07:55:38.495821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 07:55:38.495821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 07:55:38.498414 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_5b00b496a30043b093f29a81fc0694c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/5b00b496a30043b093f29a81fc0694c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5b00b496a30043b093f29a81fc0694c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5b00b496a30043b093f29a81fc0694c3"}]}] Aug 24 07:55:38.498414 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1985466249 Aug 24 07:55:38.498414 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: 5b00b496a30043b093f29a81fc0694c3 Aug 24 07:55:38.498414 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1985466249 Aug 24 07:55:38.498414 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-VolumesSnapshotsTestJSON-1985466249-project Aug 24 07:55:38.498414 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 07:55:38.498414 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 07:55:38.498414 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 8b63da4b987e41618280b19220ab6e04 Aug 24 07:55:38.498414 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1985466249-project Aug 24 07:55:38.498414 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: Aug 24 07:55:38.498414 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Volume b827b480-f7d5-41c4-9806-2a930df64ec1 could not be found. Aug 24 07:55:38.498414 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': 'b827b480-f7d5-41c4-9806-2a930df64ec1'} Aug 24 07:55:38.498414 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:55:38.499849 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:38.499849 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:55:38.499849 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:55:38.499849 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 07:55:38.499849 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 07:55:38.499849 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 07:55:38.499849 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 07:55:38.499849 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 07:55:38.499849 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 07:55:38.499849 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 07:55:38.499849 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 07:55:38.499849 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:55:38.499849 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:55:38.499849 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:55:38.499849 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:55:38.499849 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b827b480-f7d5-41c4-9806-2a930df64ec1 could not be found. (HTTP 404) (Request-ID: req-f7cb00e3-f2e4-4854-aba3-4ad410848f87) Aug 24 07:55:38.499849 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:38.499849 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:38.499849 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:38.501662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:38.501662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 07:55:38.501662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 07:55:38.501662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 07:55:38.501662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 07:55:38.501662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 07:55:38.501662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 07:55:38.501662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 07:55:38.501662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 07:55:38.501662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:55:38.501662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:55:38.501662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 07:55:38.501662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 07:55:38.501662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 07:55:38.501662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 07:55:38.501662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 07:55:38.501662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 07:55:38.501662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 07:55:38.501662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 07:55:38.505179 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:55:38.505179 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:55:38.505179 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:55:38.505179 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:55:38.505179 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b827b480-f7d5-41c4-9806-2a930df64ec1 could not be found. Aug 24 07:55:38.505179 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:38.505179 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:38.505179 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:38.505179 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:38.505179 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:55:38.505179 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:55:38.505179 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:55:38.505179 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:55:38.505179 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 07:55:38.505179 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 07:55:38.505179 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:55:38.505179 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:55:38.505179 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 07:55:38.505179 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:55:38.509520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b827b480-f7d5-41c4-9806-2a930df64ec1 could not be found. Aug 24 07:55:38.509520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:38.509520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:38.509520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:38.509520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:38.509520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:55:38.509520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:55:38.509520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:55:38.509520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:55:38.509520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b827b480-f7d5-41c4-9806-2a930df64ec1 could not be found. Aug 24 07:55:38.509520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:55:38.509520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-8973dbbb-58d9-438e-82f5-c21665544bea tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] Returning 404 to user: Volume b827b480-f7d5-41c4-9806-2a930df64ec1 could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:55:38.509520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-8973dbbb-58d9-438e-82f5-c21665544bea tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/b827b480-f7d5-41c4-9806-2a930df64ec1" status: 404 len: 109 microversion: 2.1 time: 0.149582 Aug 24 07:55:38.509520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 17/26] 10.222.0.72 () {58 vars in 1248 bytes} [Wed Aug 24 07:55:38 2022] DELETE /compute/v2.1/os-volumes/b827b480-f7d5-41c4-9806-2a930df64ec1 => generated 109 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:55:38.512181 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-572fc7db-c900-43bb-a72f-8f711facbf95 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] Calling method '.version_select at 0x7f320d7bd940>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:38.576509 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.wsgi [None req-572fc7db-c900-43bb-a72f-8f711facbf95 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] HTTP exception thrown: Volume b827b480-f7d5-41c4-9806-2a930df64ec1 could not be found. Aug 24 07:55:38.579727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-572fc7db-c900-43bb-a72f-8f711facbf95 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] Request method failure captured: Aug 24 07:55:38.579727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: request: GET /compute/v2.1/os-volumes/b827b480-f7d5-41c4-9806-2a930df64ec1 HTTP/1.1 Aug 24 07:55:38.579727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept: application/json Aug 24 07:55:38.579727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept-Encoding: identity Aug 24 07:55:38.579727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Connection: close Aug 24 07:55:38.579727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Length: 0 Aug 24 07:55:38.579727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Type: application/json Aug 24 07:55:38.579727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Host: 10.222.0.72 Aug 24 07:55:38.579727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Openstack-System-Scope: None Aug 24 07:55:38.579727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: User-Agent: python-urllib3/1.26.11 Aug 24 07:55:38.579727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Auth-Token: gAAAAABjBdlspteZQFk_-AiLBFkA1gTYuYnRSOAYHjfQcrwAvn7JWjcq4DQD4DG33HWvVnp-D24Wb27jvwp1NLkIUOg1uC2ZNYvPGK78pUfoxFG8LtAkatRIipf1qoalOmaT-6f9Gc-8qqp7lYg8CMwMBWDnun2s4pKNSO_R9Gt-VnK6Y5mHNlU Aug 24 07:55:38.579727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Id: None Aug 24 07:55:38.579727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Name: None Aug 24 07:55:38.579727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Identity-Status: Confirmed Aug 24 07:55:38.579727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Is-Admin-Project: True Aug 24 07:55:38.579727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Id: default Aug 24 07:55:38.579727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Name: Default Aug 24 07:55:38.579727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Id: 5b00b496a30043b093f29a81fc0694c3 Aug 24 07:55:38.579727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1985466249 Aug 24 07:55:38.579727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Role: reader,member Aug 24 07:55:38.579727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Roles: reader,member Aug 24 07:55:38.581233 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_5b00b496a30043b093f29a81fc0694c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/5b00b496a30043b093f29a81fc0694c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5b00b496a30043b093f29a81fc0694c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5b00b496a30043b093f29a81fc0694c3"}]}] Aug 24 07:55:38.581233 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1985466249 Aug 24 07:55:38.581233 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Id: 5b00b496a30043b093f29a81fc0694c3 Aug 24 07:55:38.581233 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1985466249 Aug 24 07:55:38.581233 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User: tempest-VolumesSnapshotsTestJSON-1985466249-project Aug 24 07:55:38.581233 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Id: default Aug 24 07:55:38.581233 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Name: Default Aug 24 07:55:38.581233 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Id: 8b63da4b987e41618280b19220ab6e04 Aug 24 07:55:38.581233 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1985466249-project Aug 24 07:55:38.581233 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: method: Aug 24 07:55:38.581233 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: exception: Volume b827b480-f7d5-41c4-9806-2a930df64ec1 could not be found. Aug 24 07:55:38.581233 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: action_args: {'id': 'b827b480-f7d5-41c4-9806-2a930df64ec1'} Aug 24 07:55:38.581233 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:55:38.581991 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:38.581991 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:55:38.581991 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:55:38.581991 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 07:55:38.581991 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 07:55:38.581991 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 07:55:38.581991 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 07:55:38.581991 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 07:55:38.581991 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 07:55:38.581991 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 07:55:38.581991 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 07:55:38.581991 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:55:38.581991 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:55:38.581991 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:55:38.581991 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:55:38.581991 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b827b480-f7d5-41c4-9806-2a930df64ec1 could not be found. (HTTP 404) (Request-ID: req-d39f7568-4ede-49f8-b5d7-e2ab178fb559) Aug 24 07:55:38.581991 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:55:38.581991 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:38.581991 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:55:38.583457 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:38.583457 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 07:55:38.583457 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 07:55:38.583457 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 07:55:38.583457 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 07:55:38.583457 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 07:55:38.583457 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 07:55:38.583457 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 07:55:38.583457 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 07:55:38.583457 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:55:38.583457 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:55:38.583457 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 07:55:38.583457 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 07:55:38.583457 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 07:55:38.583457 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 07:55:38.583457 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 07:55:38.583457 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 07:55:38.583457 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 07:55:38.583457 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 07:55:38.584562 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:55:38.584562 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:55:38.584562 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:55:38.584562 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:55:38.584562 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b827b480-f7d5-41c4-9806-2a930df64ec1 could not be found. Aug 24 07:55:38.584562 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:55:38.584562 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:38.584562 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:55:38.584562 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:38.584562 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:55:38.584562 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:55:38.584562 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:55:38.584562 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:55:38.584562 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 07:55:38.584562 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 07:55:38.584562 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:55:38.584562 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:55:38.584562 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 07:55:38.584562 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:55:38.585638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b827b480-f7d5-41c4-9806-2a930df64ec1 could not be found. Aug 24 07:55:38.585638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:55:38.585638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:55:38.585638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:55:38.585638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:55:38.585638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:55:38.585638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:55:38.585638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:55:38.585638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:55:38.585638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b827b480-f7d5-41c4-9806-2a930df64ec1 could not be found. Aug 24 07:55:38.585638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:55:38.585638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-572fc7db-c900-43bb-a72f-8f711facbf95 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] Returning 404 to user: Volume b827b480-f7d5-41c4-9806-2a930df64ec1 could not be found. {{(pid=127590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:55:38.587925 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-572fc7db-c900-43bb-a72f-8f711facbf95 tempest-VolumesSnapshotsTestJSON-1985466249 tempest-VolumesSnapshotsTestJSON-1985466249-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/b827b480-f7d5-41c4-9806-2a930df64ec1" status: 404 len: 109 microversion: 2.1 time: 0.086962 Aug 24 07:55:38.588560 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 10/27] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 24 07:55:38 2022] GET /compute/v2.1/os-volumes/b827b480-f7d5-41c4-9806-2a930df64ec1 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:55:40.703759 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b0ded2d7-69b1-4060-a825-9b77e546e54a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-110640567", "imageRef": "ccdab334-55ce-4ff5-bd97-5a424660c282", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:40.825169 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-25cdc1cb-7da5-4ea1-a16c-19ca2dbe72eb tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-508422212", "imageRef": "ccdab334-55ce-4ff5-bd97-5a424660c282", "flavorRef": "452", "networks": [{"uuid": "00f0eb35-7210-4b2e-9f07-2d659f7b3ce3"}]}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:41.035286 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.network.neutron [None req-b0ded2d7-69b1-4060-a825-9b77e546e54a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] validate_networks() for [('65ded553-11ab-4374-ae54-fd59db440a78', None, None, None, None, None)] {{(pid=127589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:55:41.099728 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.network.neutron [None req-25cdc1cb-7da5-4ea1-a16c-19ca2dbe72eb tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] validate_networks() for [('00f0eb35-7210-4b2e-9f07-2d659f7b3ce3', None, None, None, None, None)] {{(pid=127590) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:55:42.845131 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-b0ded2d7-69b1-4060-a825-9b77e546e54a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Flavor limits 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:55:42.846260 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-b0ded2d7-69b1-4060-a825-9b77e546e54a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Image limits 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:55:42.846995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-b0ded2d7-69b1-4060-a825-9b77e546e54a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Flavor pref 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:55:42.847625 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-b0ded2d7-69b1-4060-a825-9b77e546e54a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Image pref 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:55:42.848260 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-b0ded2d7-69b1-4060-a825-9b77e546e54a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:55:42.883445 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b0ded2d7-69b1-4060-a825-9b77e546e54a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:42.883947 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b0ded2d7-69b1-4060-a825-9b77e546e54a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:42.884393 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b0ded2d7-69b1-4060-a825-9b77e546e54a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:42.889645 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b0ded2d7-69b1-4060-a825-9b77e546e54a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:42.890144 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b0ded2d7-69b1-4060-a825-9b77e546e54a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:42.892357 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b0ded2d7-69b1-4060-a825-9b77e546e54a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:43.003404 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.quota [None req-b0ded2d7-69b1-4060-a825-9b77e546e54a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Getting quotas for project e52495240cf04548a21b411c32bbe1e1. Resources: {'cores', 'instances', 'ram'} {{(pid=127589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:55:43.026921 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.quota [None req-b0ded2d7-69b1-4060-a825-9b77e546e54a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Getting quotas for user 51729e82a3784d04aef89ed83f1576bd and project e52495240cf04548a21b411c32bbe1e1. Resources: {'cores', 'instances', 'ram'} {{(pid=127589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:55:43.069615 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-b0ded2d7-69b1-4060-a825-9b77e546e54a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Going to run 1 instances... {{(pid=127589) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:55:43.072453 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-b0ded2d7-69b1-4060-a825-9b77e546e54a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccdab334-55ce-4ff5-bd97-5a424660c282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:55:43.079186 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-25cdc1cb-7da5-4ea1-a16c-19ca2dbe72eb tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Flavor limits 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:55:43.079682 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-25cdc1cb-7da5-4ea1-a16c-19ca2dbe72eb tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Image limits 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:55:43.081216 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-25cdc1cb-7da5-4ea1-a16c-19ca2dbe72eb tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Flavor pref 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:55:43.084299 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-25cdc1cb-7da5-4ea1-a16c-19ca2dbe72eb tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Image pref 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:55:43.084925 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-25cdc1cb-7da5-4ea1-a16c-19ca2dbe72eb tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:55:43.114011 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-25cdc1cb-7da5-4ea1-a16c-19ca2dbe72eb tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:43.116167 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-25cdc1cb-7da5-4ea1-a16c-19ca2dbe72eb tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:43.117263 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-25cdc1cb-7da5-4ea1-a16c-19ca2dbe72eb tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:43.118680 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-25cdc1cb-7da5-4ea1-a16c-19ca2dbe72eb tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:43.119318 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-25cdc1cb-7da5-4ea1-a16c-19ca2dbe72eb tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:43.119890 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-25cdc1cb-7da5-4ea1-a16c-19ca2dbe72eb tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:43.150750 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-25cdc1cb-7da5-4ea1-a16c-19ca2dbe72eb tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Getting quotas for project 601816703e524795ab40b1dea9393870. Resources: {'cores', 'instances', 'ram'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:55:43.156683 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-25cdc1cb-7da5-4ea1-a16c-19ca2dbe72eb tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Getting quotas for user c772000142f14498933a685d3855bc02 and project 601816703e524795ab40b1dea9393870. Resources: {'cores', 'instances', 'ram'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:55:43.171167 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-25cdc1cb-7da5-4ea1-a16c-19ca2dbe72eb tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Going to run 1 instances... {{(pid=127590) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:55:43.174143 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-25cdc1cb-7da5-4ea1-a16c-19ca2dbe72eb tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccdab334-55ce-4ff5-bd97-5a424660c282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:55:43.355039 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-b0ded2d7-69b1-4060-a825-9b77e546e54a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.388788 Aug 24 07:55:43.362626 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 18/28] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 24 07:55:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 3398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:55:43.368471 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b4b36a55-a0e9-4d43-a74a-856ffeb61642 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-318029379", "imageRef": "ccdab334-55ce-4ff5-bd97-5a424660c282", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dac6160e-2a1d-42ce-8220-e6f39a4fb0ee"}], "security_groups": [{"name": "tempest-securitygroup--1381622145"}], "key_name": "tempest-keypair-1678806733", "user_data": "}} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:43.479911 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-25cdc1cb-7da5-4ea1-a16c-19ca2dbe72eb tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.026118 Aug 24 07:55:43.480609 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 11/29] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 24 07:55:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 3029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:55:43.495707 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-db9b9002-85c1-4892-b8e6-cec2c39694a1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:43.498469 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-db9b9002-85c1-4892-b8e6-cec2c39694a1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:43.556662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.network.neutron [None req-b4b36a55-a0e9-4d43-a74a-856ffeb61642 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] validate_networks() for [('dac6160e-2a1d-42ce-8220-e6f39a4fb0ee', None, None, None, None, None)] {{(pid=127589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:55:43.690959 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-db9b9002-85c1-4892-b8e6-cec2c39694a1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:43.716700 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-db9b9002-85c1-4892-b8e6-cec2c39694a1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 200 len: 1221 microversion: 2.1 time: 0.227932 Aug 24 07:55:43.737102 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 12/30] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:43 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 1221 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:43.745589 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-ad41a49c-edd4-441a-a22e-7cc1c6a27852 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:43.747490 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-ad41a49c-edd4-441a-a22e-7cc1c6a27852 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:43.816838 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-ad41a49c-edd4-441a-a22e-7cc1c6a27852 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:43.825411 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-ad41a49c-edd4-441a-a22e-7cc1c6a27852 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1214 microversion: 2.1 time: 0.091701 Aug 24 07:55:43.828744 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 13/31] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:43 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:44.147252 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-4b1bf31e-e76c-4d14-88cd-2844b987f84d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1263829708", "imageRef": "ccdab334-55ce-4ff5-bd97-5a424660c282", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:44.279376 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.network.neutron [None req-4b1bf31e-e76c-4d14-88cd-2844b987f84d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] validate_networks() for [('65ded553-11ab-4374-ae54-fd59db440a78', None, None, None, None, None)] {{(pid=127590) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:55:44.414806 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-b4b36a55-a0e9-4d43-a74a-856ffeb61642 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Flavor limits 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:55:44.415312 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-b4b36a55-a0e9-4d43-a74a-856ffeb61642 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Image limits 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:55:44.415844 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-b4b36a55-a0e9-4d43-a74a-856ffeb61642 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Flavor pref 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:55:44.416265 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-b4b36a55-a0e9-4d43-a74a-856ffeb61642 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Image pref 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:55:44.416717 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-b4b36a55-a0e9-4d43-a74a-856ffeb61642 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:55:44.448474 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b4b36a55-a0e9-4d43-a74a-856ffeb61642 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:44.456831 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b4b36a55-a0e9-4d43-a74a-856ffeb61642 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:44.457332 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b4b36a55-a0e9-4d43-a74a-856ffeb61642 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:44.458148 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b4b36a55-a0e9-4d43-a74a-856ffeb61642 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:44.479616 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b4b36a55-a0e9-4d43-a74a-856ffeb61642 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:44.482278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b4b36a55-a0e9-4d43-a74a-856ffeb61642 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:44.540185 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.quota [None req-b4b36a55-a0e9-4d43-a74a-856ffeb61642 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Getting quotas for project 27c8e372420a4076b855d46a4f8ff521. Resources: {'cores', 'instances', 'ram'} {{(pid=127589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:55:44.545239 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.quota [None req-b4b36a55-a0e9-4d43-a74a-856ffeb61642 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Getting quotas for user d318793a5fee43bdb1a043b30396884b and project 27c8e372420a4076b855d46a4f8ff521. Resources: {'cores', 'instances', 'ram'} {{(pid=127589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:55:44.561744 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-b4b36a55-a0e9-4d43-a74a-856ffeb61642 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Going to run 1 instances... {{(pid=127589) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:55:44.565511 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-b4b36a55-a0e9-4d43-a74a-856ffeb61642 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccdab334-55ce-4ff5-bd97-5a424660c282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:55:44.937212 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-b4b36a55-a0e9-4d43-a74a-856ffeb61642 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.573167 Aug 24 07:55:44.948294 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 19/32] 10.222.0.72 () {62 vars in 1188 bytes} [Wed Aug 24 07:55:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 07:55:44.954451 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-33f580ff-52f0-444e-b373-2b56bfaee70a tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:44.954961 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-4b1bf31e-e76c-4d14-88cd-2844b987f84d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Flavor limits 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:55:44.956203 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-4b1bf31e-e76c-4d14-88cd-2844b987f84d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Image limits 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:55:44.956915 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-4b1bf31e-e76c-4d14-88cd-2844b987f84d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Flavor pref 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:55:44.957437 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-4b1bf31e-e76c-4d14-88cd-2844b987f84d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Image pref 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:55:44.957806 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-33f580ff-52f0-444e-b373-2b56bfaee70a tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:44.957920 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-4b1bf31e-e76c-4d14-88cd-2844b987f84d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:55:44.976484 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4b1bf31e-e76c-4d14-88cd-2844b987f84d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:44.980925 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4b1bf31e-e76c-4d14-88cd-2844b987f84d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:44.980925 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4b1bf31e-e76c-4d14-88cd-2844b987f84d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:44.982443 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4b1bf31e-e76c-4d14-88cd-2844b987f84d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:44.984228 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4b1bf31e-e76c-4d14-88cd-2844b987f84d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:44.984879 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4b1bf31e-e76c-4d14-88cd-2844b987f84d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:45.041923 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-4b1bf31e-e76c-4d14-88cd-2844b987f84d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Getting quotas for project e52495240cf04548a21b411c32bbe1e1. Resources: {'cores', 'instances', 'ram'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:55:45.063316 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-4b1bf31e-e76c-4d14-88cd-2844b987f84d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Getting quotas for user 51729e82a3784d04aef89ed83f1576bd and project e52495240cf04548a21b411c32bbe1e1. Resources: {'cores', 'instances', 'ram'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:55:45.088547 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-4b1bf31e-e76c-4d14-88cd-2844b987f84d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Going to run 1 instances... {{(pid=127590) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:55:45.091436 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-4b1bf31e-e76c-4d14-88cd-2844b987f84d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccdab334-55ce-4ff5-bd97-5a424660c282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:55:45.211992 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-33f580ff-52f0-444e-b373-2b56bfaee70a tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:45.234641 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-33f580ff-52f0-444e-b373-2b56bfaee70a tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1214 microversion: 2.1 time: 0.287781 Aug 24 07:55:45.235637 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 20/33] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:44 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1214 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:45.241628 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-99b90156-52ec-40a0-b9af-49e09ec9fd18 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:45.242549 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-99b90156-52ec-40a0-b9af-49e09ec9fd18 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:45.442995 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-4b1bf31e-e76c-4d14-88cd-2844b987f84d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.292506 Aug 24 07:55:45.444238 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 14/34] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 24 07:55:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 1304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 07:55:45.476371 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-b4662c16-af49-4bc2-8335-3f60b8e6e6a4 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:45.494751 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-b4662c16-af49-4bc2-8335-3f60b8e6e6a4 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:45.724183 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-b4662c16-af49-4bc2-8335-3f60b8e6e6a4 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:45.734571 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-b4662c16-af49-4bc2-8335-3f60b8e6e6a4 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1222 microversion: 2.1 time: 0.281212 Aug 24 07:55:45.750632 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 15/35] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:45 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1222 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:45.879033 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-99b90156-52ec-40a0-b9af-49e09ec9fd18 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:45.887953 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-99b90156-52ec-40a0-b9af-49e09ec9fd18 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:45.902205 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-99b90156-52ec-40a0-b9af-49e09ec9fd18 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:45.908047 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-99b90156-52ec-40a0-b9af-49e09ec9fd18 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1281 microversion: 2.20 time: 0.669032 Aug 24 07:55:45.911899 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 21/36] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:55:45 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1281 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:55:46.257713 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-0936af6b-ad3e-4a12-b1ff-58c1d87e0bc6 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:46.258337 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-0936af6b-ad3e-4a12-b1ff-58c1d87e0bc6 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:46.357746 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-0936af6b-ad3e-4a12-b1ff-58c1d87e0bc6 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:46.365747 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-0936af6b-ad3e-4a12-b1ff-58c1d87e0bc6 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1214 microversion: 2.1 time: 0.112001 Aug 24 07:55:46.380082 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 16/37] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:46 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1214 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:46.757408 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-d308bc1f-bfee-4432-9eaa-63481e5c7687 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:46.758286 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-d308bc1f-bfee-4432-9eaa-63481e5c7687 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:46.859500 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-d308bc1f-bfee-4432-9eaa-63481e5c7687 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:46.876845 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-d308bc1f-bfee-4432-9eaa-63481e5c7687 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1222 microversion: 2.1 time: 0.123085 Aug 24 07:55:46.881229 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 22/38] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:46 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1222 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:46.937621 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-6afa1ff1-85c3-4e30-860f-5a1be86596b2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:46.938752 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-6afa1ff1-85c3-4e30-860f-5a1be86596b2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:47.031692 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-6afa1ff1-85c3-4e30-860f-5a1be86596b2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:47.044192 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-6afa1ff1-85c3-4e30-860f-5a1be86596b2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:47.046167 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-6afa1ff1-85c3-4e30-860f-5a1be86596b2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:47.049739 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-6afa1ff1-85c3-4e30-860f-5a1be86596b2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1281 microversion: 2.20 time: 0.116725 Aug 24 07:55:47.050819 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 17/39] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:55:46 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1281 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:55:47.387547 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b3c24c63-6f78-4011-9d08-abdda81d1f7e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:47.388163 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-b3c24c63-6f78-4011-9d08-abdda81d1f7e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:47.395710 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b3c24c63-6f78-4011-9d08-abdda81d1f7e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:47.396201 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b3c24c63-6f78-4011-9d08-abdda81d1f7e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:47.396833 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b3c24c63-6f78-4011-9d08-abdda81d1f7e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:47.397546 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b3c24c63-6f78-4011-9d08-abdda81d1f7e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:47.398220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b3c24c63-6f78-4011-9d08-abdda81d1f7e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:47.398655 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b3c24c63-6f78-4011-9d08-abdda81d1f7e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:47.640514 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b3c24c63-6f78-4011-9d08-abdda81d1f7e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:47.663777 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-b3c24c63-6f78-4011-9d08-abdda81d1f7e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1210 microversion: 2.1 time: 0.280301 Aug 24 07:55:47.665219 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 23/40] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:47 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1210 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:47.901371 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-06d83867-4f0b-4a49-89ed-46fce0e092a0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:47.902156 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-06d83867-4f0b-4a49-89ed-46fce0e092a0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:47.908706 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-06d83867-4f0b-4a49-89ed-46fce0e092a0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:47.909200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-06d83867-4f0b-4a49-89ed-46fce0e092a0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:47.909642 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-06d83867-4f0b-4a49-89ed-46fce0e092a0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:47.910408 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-06d83867-4f0b-4a49-89ed-46fce0e092a0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:47.910868 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-06d83867-4f0b-4a49-89ed-46fce0e092a0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:47.911295 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-06d83867-4f0b-4a49-89ed-46fce0e092a0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:48.076840 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-2afd666f-d3ee-4a6f-af7a-afafa3c1b692 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:48.078311 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-2afd666f-d3ee-4a6f-af7a-afafa3c1b692 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:48.092847 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2afd666f-d3ee-4a6f-af7a-afafa3c1b692 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:48.094126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2afd666f-d3ee-4a6f-af7a-afafa3c1b692 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:48.095427 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-06d83867-4f0b-4a49-89ed-46fce0e092a0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:48.096075 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2afd666f-d3ee-4a6f-af7a-afafa3c1b692 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:48.098345 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2afd666f-d3ee-4a6f-af7a-afafa3c1b692 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:48.098833 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2afd666f-d3ee-4a6f-af7a-afafa3c1b692 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:48.100567 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2afd666f-d3ee-4a6f-af7a-afafa3c1b692 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:48.109279 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-06d83867-4f0b-4a49-89ed-46fce0e092a0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1218 microversion: 2.1 time: 0.211865 Aug 24 07:55:48.110209 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 18/41] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:47 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1218 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:48.184860 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-2afd666f-d3ee-4a6f-af7a-afafa3c1b692 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:48.218504 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-2afd666f-d3ee-4a6f-af7a-afafa3c1b692 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:48.220029 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-2afd666f-d3ee-4a6f-af7a-afafa3c1b692 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:48.221373 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-2afd666f-d3ee-4a6f-af7a-afafa3c1b692 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1277 microversion: 2.20 time: 0.153026 Aug 24 07:55:48.235325 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 24/42] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:55:48 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:55:48.690188 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-aa62f63f-a8e9-473b-946c-8ec6c3aa2893 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:48.691016 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-aa62f63f-a8e9-473b-946c-8ec6c3aa2893 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:48.706284 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-aa62f63f-a8e9-473b-946c-8ec6c3aa2893 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:48.708249 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-aa62f63f-a8e9-473b-946c-8ec6c3aa2893 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:48.709462 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-aa62f63f-a8e9-473b-946c-8ec6c3aa2893 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:48.710752 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-aa62f63f-a8e9-473b-946c-8ec6c3aa2893 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:48.712623 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-aa62f63f-a8e9-473b-946c-8ec6c3aa2893 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:48.714039 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-aa62f63f-a8e9-473b-946c-8ec6c3aa2893 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:48.811287 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-aa62f63f-a8e9-473b-946c-8ec6c3aa2893 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:48.826306 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-aa62f63f-a8e9-473b-946c-8ec6c3aa2893 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1274 microversion: 2.1 time: 0.140027 Aug 24 07:55:48.827389 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 19/43] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:48 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1274 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:49.131839 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-7be8d06a-1824-418e-a275-eb0e94cc55ac tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:49.132459 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-7be8d06a-1824-418e-a275-eb0e94cc55ac tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:49.140231 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7be8d06a-1824-418e-a275-eb0e94cc55ac tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:49.141113 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7be8d06a-1824-418e-a275-eb0e94cc55ac tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:49.142123 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7be8d06a-1824-418e-a275-eb0e94cc55ac tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:49.143556 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7be8d06a-1824-418e-a275-eb0e94cc55ac tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:49.144190 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7be8d06a-1824-418e-a275-eb0e94cc55ac tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:49.144923 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7be8d06a-1824-418e-a275-eb0e94cc55ac tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:49.247307 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-baae2f3d-1828-4fe0-81f7-2d3ab733e704 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:49.248066 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-baae2f3d-1828-4fe0-81f7-2d3ab733e704 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:49.262973 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-baae2f3d-1828-4fe0-81f7-2d3ab733e704 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:49.265228 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-baae2f3d-1828-4fe0-81f7-2d3ab733e704 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:49.267310 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-baae2f3d-1828-4fe0-81f7-2d3ab733e704 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:49.270780 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-baae2f3d-1828-4fe0-81f7-2d3ab733e704 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:49.274672 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-baae2f3d-1828-4fe0-81f7-2d3ab733e704 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:49.283047 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-baae2f3d-1828-4fe0-81f7-2d3ab733e704 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:49.343398 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7be8d06a-1824-418e-a275-eb0e94cc55ac tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:49.353418 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-7be8d06a-1824-418e-a275-eb0e94cc55ac tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1282 microversion: 2.1 time: 0.226207 Aug 24 07:55:49.360896 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 25/44] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:49 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1282 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:49.699909 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-baae2f3d-1828-4fe0-81f7-2d3ab733e704 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:49.710557 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-baae2f3d-1828-4fe0-81f7-2d3ab733e704 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:49.723243 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-baae2f3d-1828-4fe0-81f7-2d3ab733e704 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:49.724912 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-baae2f3d-1828-4fe0-81f7-2d3ab733e704 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1341 microversion: 2.20 time: 0.482376 Aug 24 07:55:49.727183 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 20/45] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:55:49 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1341 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:55:49.860157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-1983f96c-1718-4c57-9aad-70b8b9dbcbb2 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:49.861915 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-1983f96c-1718-4c57-9aad-70b8b9dbcbb2 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:49.903759 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1983f96c-1718-4c57-9aad-70b8b9dbcbb2 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:49.909375 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1983f96c-1718-4c57-9aad-70b8b9dbcbb2 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:49.912557 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1983f96c-1718-4c57-9aad-70b8b9dbcbb2 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:49.921117 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1983f96c-1718-4c57-9aad-70b8b9dbcbb2 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:49.927440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1983f96c-1718-4c57-9aad-70b8b9dbcbb2 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:49.928091 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1983f96c-1718-4c57-9aad-70b8b9dbcbb2 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:50.204301 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-1983f96c-1718-4c57-9aad-70b8b9dbcbb2 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:50.215769 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-1983f96c-1718-4c57-9aad-70b8b9dbcbb2 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1272 microversion: 2.1 time: 0.364885 Aug 24 07:55:50.216420 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 26/46] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:49 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1272 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:50.386071 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-9b8a1b91-3758-44e3-a298-e20922c9270f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:50.386739 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-9b8a1b91-3758-44e3-a298-e20922c9270f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:50.413465 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9b8a1b91-3758-44e3-a298-e20922c9270f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:50.415505 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9b8a1b91-3758-44e3-a298-e20922c9270f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:50.419217 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9b8a1b91-3758-44e3-a298-e20922c9270f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:50.420029 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9b8a1b91-3758-44e3-a298-e20922c9270f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:50.420511 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9b8a1b91-3758-44e3-a298-e20922c9270f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:50.426245 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9b8a1b91-3758-44e3-a298-e20922c9270f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:50.573617 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9b8a1b91-3758-44e3-a298-e20922c9270f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:50.581454 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-9b8a1b91-3758-44e3-a298-e20922c9270f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1280 microversion: 2.1 time: 0.204177 Aug 24 07:55:50.582532 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 21/47] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:50 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1280 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:50.755268 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-10b63135-44e7-4f41-83a7-c534ef05b244 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:50.756060 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-10b63135-44e7-4f41-83a7-c534ef05b244 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:50.785306 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-10b63135-44e7-4f41-83a7-c534ef05b244 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:50.786126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-10b63135-44e7-4f41-83a7-c534ef05b244 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:50.787661 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-10b63135-44e7-4f41-83a7-c534ef05b244 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:50.789654 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-10b63135-44e7-4f41-83a7-c534ef05b244 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:50.792129 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-10b63135-44e7-4f41-83a7-c534ef05b244 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:50.793769 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-10b63135-44e7-4f41-83a7-c534ef05b244 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:51.045655 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-10b63135-44e7-4f41-83a7-c534ef05b244 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:51.070574 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-10b63135-44e7-4f41-83a7-c534ef05b244 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:51.073374 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-10b63135-44e7-4f41-83a7-c534ef05b244 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:51.075801 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-10b63135-44e7-4f41-83a7-c534ef05b244 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1339 microversion: 2.20 time: 0.325489 Aug 24 07:55:51.077087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 27/48] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:55:50 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1339 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:55:51.241691 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-7a8e9c48-dc77-4c75-b946-e958b01f96d4 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:51.242555 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-7a8e9c48-dc77-4c75-b946-e958b01f96d4 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:51.254152 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7a8e9c48-dc77-4c75-b946-e958b01f96d4 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:51.255497 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7a8e9c48-dc77-4c75-b946-e958b01f96d4 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:51.257358 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7a8e9c48-dc77-4c75-b946-e958b01f96d4 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:51.259121 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7a8e9c48-dc77-4c75-b946-e958b01f96d4 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:51.260401 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7a8e9c48-dc77-4c75-b946-e958b01f96d4 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:51.263398 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7a8e9c48-dc77-4c75-b946-e958b01f96d4 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:51.607398 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-2802f14d-574f-4139-9f22-e1fb59188e0b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:51.608121 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-2802f14d-574f-4139-9f22-e1fb59188e0b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:51.615329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2802f14d-574f-4139-9f22-e1fb59188e0b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:51.615831 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2802f14d-574f-4139-9f22-e1fb59188e0b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:51.616277 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2802f14d-574f-4139-9f22-e1fb59188e0b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:51.617043 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2802f14d-574f-4139-9f22-e1fb59188e0b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:51.617501 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2802f14d-574f-4139-9f22-e1fb59188e0b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:51.625750 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2802f14d-574f-4139-9f22-e1fb59188e0b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:51.953006 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-7a8e9c48-dc77-4c75-b946-e958b01f96d4 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:51.984227 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-7a8e9c48-dc77-4c75-b946-e958b01f96d4 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1314 microversion: 2.1 time: 0.735609 Aug 24 07:55:51.984927 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 22/49] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:51 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1314 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:52.106165 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-701e57bb-902e-47d1-8cda-b10adca93b6d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:52.107887 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-701e57bb-902e-47d1-8cda-b10adca93b6d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:52.124371 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-701e57bb-902e-47d1-8cda-b10adca93b6d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:52.125398 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-701e57bb-902e-47d1-8cda-b10adca93b6d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:52.126160 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-701e57bb-902e-47d1-8cda-b10adca93b6d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:52.127152 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-701e57bb-902e-47d1-8cda-b10adca93b6d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:52.131014 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-701e57bb-902e-47d1-8cda-b10adca93b6d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:52.131802 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-701e57bb-902e-47d1-8cda-b10adca93b6d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:52.249970 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-2802f14d-574f-4139-9f22-e1fb59188e0b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:52.268104 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-2802f14d-574f-4139-9f22-e1fb59188e0b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1280 microversion: 2.1 time: 0.664812 Aug 24 07:55:52.268621 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 28/50] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:51 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1280 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:52.593711 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-701e57bb-902e-47d1-8cda-b10adca93b6d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:52.593711 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-701e57bb-902e-47d1-8cda-b10adca93b6d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:52.598670 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-701e57bb-902e-47d1-8cda-b10adca93b6d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:52.598670 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-701e57bb-902e-47d1-8cda-b10adca93b6d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1407 microversion: 2.20 time: 0.310193 Aug 24 07:55:52.598670 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 23/51] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:55:52 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1407 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:55:53.006824 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-7e1016ab-a830-4d5c-9161-8b1c07b7c874 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:53.008129 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-7e1016ab-a830-4d5c-9161-8b1c07b7c874 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:53.017275 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7e1016ab-a830-4d5c-9161-8b1c07b7c874 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:53.020304 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7e1016ab-a830-4d5c-9161-8b1c07b7c874 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:53.020957 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7e1016ab-a830-4d5c-9161-8b1c07b7c874 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:53.021842 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7e1016ab-a830-4d5c-9161-8b1c07b7c874 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:53.023970 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7e1016ab-a830-4d5c-9161-8b1c07b7c874 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:53.025886 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7e1016ab-a830-4d5c-9161-8b1c07b7c874 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:53.295633 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-81123dd4-42d4-48bc-b768-c3acd16b3b40 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:53.296327 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-81123dd4-42d4-48bc-b768-c3acd16b3b40 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:53.308342 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-81123dd4-42d4-48bc-b768-c3acd16b3b40 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:53.308909 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-81123dd4-42d4-48bc-b768-c3acd16b3b40 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:53.310011 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-81123dd4-42d4-48bc-b768-c3acd16b3b40 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:53.313014 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-81123dd4-42d4-48bc-b768-c3acd16b3b40 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:53.313551 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-81123dd4-42d4-48bc-b768-c3acd16b3b40 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:53.325457 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-81123dd4-42d4-48bc-b768-c3acd16b3b40 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:53.526433 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7e1016ab-a830-4d5c-9161-8b1c07b7c874 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:53.534347 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-7e1016ab-a830-4d5c-9161-8b1c07b7c874 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1314 microversion: 2.1 time: 0.531986 Aug 24 07:55:53.541037 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 29/52] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:53 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:53.563931 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-0ee08410-eccc-4c6a-a681-e5fcaca9270e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:53.566448 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-0ee08410-eccc-4c6a-a681-e5fcaca9270e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:53.572799 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0ee08410-eccc-4c6a-a681-e5fcaca9270e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:53.576771 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0ee08410-eccc-4c6a-a681-e5fcaca9270e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:53.577388 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0ee08410-eccc-4c6a-a681-e5fcaca9270e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:53.578290 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0ee08410-eccc-4c6a-a681-e5fcaca9270e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:53.581619 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0ee08410-eccc-4c6a-a681-e5fcaca9270e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:53.583189 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0ee08410-eccc-4c6a-a681-e5fcaca9270e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:53.904026 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-81123dd4-42d4-48bc-b768-c3acd16b3b40 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:53.921191 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-81123dd4-42d4-48bc-b768-c3acd16b3b40 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1322 microversion: 2.1 time: 0.629847 Aug 24 07:55:53.936800 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 24/53] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:53 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1322 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:54.033412 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-0ee08410-eccc-4c6a-a681-e5fcaca9270e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:54.041572 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-0ee08410-eccc-4c6a-a681-e5fcaca9270e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:54.043922 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-0ee08410-eccc-4c6a-a681-e5fcaca9270e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:54.045245 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-0ee08410-eccc-4c6a-a681-e5fcaca9270e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1407 microversion: 2.20 time: 0.485271 Aug 24 07:55:54.057065 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 30/54] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:55:53 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1407 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:55:54.562597 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-a940ea63-86e7-4187-ba64-5aa42c0020bd tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:54.564772 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-a940ea63-86e7-4187-ba64-5aa42c0020bd tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:54.574729 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a940ea63-86e7-4187-ba64-5aa42c0020bd tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:54.576181 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a940ea63-86e7-4187-ba64-5aa42c0020bd tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:54.577249 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a940ea63-86e7-4187-ba64-5aa42c0020bd tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:54.580895 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a940ea63-86e7-4187-ba64-5aa42c0020bd tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:54.581641 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a940ea63-86e7-4187-ba64-5aa42c0020bd tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:54.582959 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a940ea63-86e7-4187-ba64-5aa42c0020bd tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:54.951015 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-5f8e034f-0403-4a2d-b9c8-e17fc59a1656 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:54.954864 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-5f8e034f-0403-4a2d-b9c8-e17fc59a1656 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:54.996852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=4 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:55.002826 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=4 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:55.009167 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5f8e034f-0403-4a2d-b9c8-e17fc59a1656 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:55.013007 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5f8e034f-0403-4a2d-b9c8-e17fc59a1656 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:55.013761 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5f8e034f-0403-4a2d-b9c8-e17fc59a1656 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:55.019702 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5f8e034f-0403-4a2d-b9c8-e17fc59a1656 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:55.021780 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5f8e034f-0403-4a2d-b9c8-e17fc59a1656 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:55.027963 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5f8e034f-0403-4a2d-b9c8-e17fc59a1656 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:55.845913 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-a940ea63-86e7-4187-ba64-5aa42c0020bd tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:55.889893 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-a940ea63-86e7-4187-ba64-5aa42c0020bd tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1314 microversion: 2.1 time: 1.330673 Aug 24 07:55:55.895532 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 25/55] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:54 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1314 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:55.910717 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-02a5a7f6-2d37-4de5-8c05-0994c93f1aec tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:55.911314 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-02a5a7f6-2d37-4de5-8c05-0994c93f1aec tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:55.926813 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-02a5a7f6-2d37-4de5-8c05-0994c93f1aec tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:55.929599 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-02a5a7f6-2d37-4de5-8c05-0994c93f1aec tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:55.929800 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-02a5a7f6-2d37-4de5-8c05-0994c93f1aec tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:55.930584 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-02a5a7f6-2d37-4de5-8c05-0994c93f1aec tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:55.931058 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-02a5a7f6-2d37-4de5-8c05-0994c93f1aec tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:55.931488 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-02a5a7f6-2d37-4de5-8c05-0994c93f1aec tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:55.973410 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-5f8e034f-0403-4a2d-b9c8-e17fc59a1656 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:56.012762 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-5f8e034f-0403-4a2d-b9c8-e17fc59a1656 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1322 microversion: 2.1 time: 1.067590 Aug 24 07:55:56.016730 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 31/56] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:54 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1322 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:56.468614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-4fe57458-b4d5-4024-99fd-e2217b9fd287 req-20dbfb0b-2273-4c78-8351-8850c24cb914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb0fc412-e048-4edd-9a89-5aaaebb38a42", "tag": "5a81c1e6-d657-4fb4-a660-b452ce1735b0"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:56.503009 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-4fe57458-b4d5-4024-99fd-e2217b9fd287 req-20dbfb0b-2273-4c78-8351-8850c24cb914 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:56.504525 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-4fe57458-b4d5-4024-99fd-e2217b9fd287 req-20dbfb0b-2273-4c78-8351-8850c24cb914 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:56.504525 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-4fe57458-b4d5-4024-99fd-e2217b9fd287 req-20dbfb0b-2273-4c78-8351-8850c24cb914 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:56.574188 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-4fe57458-b4d5-4024-99fd-e2217b9fd287 req-20dbfb0b-2273-4c78-8351-8850c24cb914 service nova] Creating event network-changed:5a81c1e6-d657-4fb4-a660-b452ce1735b0 for instance fb0fc412-e048-4edd-9a89-5aaaebb38a42 on hv-cinder-85427 Aug 24 07:55:56.574720 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-4fe57458-b4d5-4024-99fd-e2217b9fd287 req-20dbfb0b-2273-4c78-8351-8850c24cb914 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 07:55:56.575119 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-4fe57458-b4d5-4024-99fd-e2217b9fd287 req-20dbfb0b-2273-4c78-8351-8850c24cb914 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 07:55:56.576147 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-da65a0b1-d89a-4499-b343-c2fdfa08637b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:56.589476 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-da65a0b1-d89a-4499-b343-c2fdfa08637b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:56.590187 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-da65a0b1-d89a-4499-b343-c2fdfa08637b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:56.591135 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-da65a0b1-d89a-4499-b343-c2fdfa08637b None None] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:56.591736 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-da65a0b1-d89a-4499-b343-c2fdfa08637b None None] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:56.592165 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-da65a0b1-d89a-4499-b343-c2fdfa08637b None None] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:56.614894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.compute.rpcapi [None req-da65a0b1-d89a-4499-b343-c2fdfa08637b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 07:55:56.616133 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-da65a0b1-d89a-4499-b343-c2fdfa08637b None None] Releasing lock "compute-rpcapi-router" {{(pid=127589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 07:55:56.647316 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-da65a0b1-d89a-4499-b343-c2fdfa08637b None None] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.631835 Aug 24 07:55:56.648686 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 32/57] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:55:56.860614 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-02a5a7f6-2d37-4de5-8c05-0994c93f1aec tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:56.868705 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-02a5a7f6-2d37-4de5-8c05-0994c93f1aec tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:56.873335 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=18 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:56.882050 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-02a5a7f6-2d37-4de5-8c05-0994c93f1aec tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:56.883576 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-02a5a7f6-2d37-4de5-8c05-0994c93f1aec tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1407 microversion: 2.20 time: 0.983238 Aug 24 07:55:56.890691 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 26/58] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:55:55 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1407 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:55:56.914443 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-b47acf50-34d6-463e-bd6e-a48ee032a177 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:56.915219 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-b47acf50-34d6-463e-bd6e-a48ee032a177 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:56.936633 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b47acf50-34d6-463e-bd6e-a48ee032a177 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:56.937165 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b47acf50-34d6-463e-bd6e-a48ee032a177 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:56.940996 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b47acf50-34d6-463e-bd6e-a48ee032a177 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:56.940996 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b47acf50-34d6-463e-bd6e-a48ee032a177 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:56.940996 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b47acf50-34d6-463e-bd6e-a48ee032a177 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:56.940996 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b47acf50-34d6-463e-bd6e-a48ee032a177 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:57.040134 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=26 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:57.233387 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-faf83a92-8054-4a9a-9061-bc8e7be92780 req-806dbe08-cbed-4bb7-8e70-36110e921775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da017fd6-2861-4ef8-b216-cb16309cdf1b", "tag": "cddb0d7e-7022-4a60-ba3b-4112336a886c"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:57.256185 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-faf83a92-8054-4a9a-9061-bc8e7be92780 req-806dbe08-cbed-4bb7-8e70-36110e921775 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:57.275228 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-faf83a92-8054-4a9a-9061-bc8e7be92780 req-806dbe08-cbed-4bb7-8e70-36110e921775 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:57.277218 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-faf83a92-8054-4a9a-9061-bc8e7be92780 req-806dbe08-cbed-4bb7-8e70-36110e921775 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:57.296457 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-faf83a92-8054-4a9a-9061-bc8e7be92780 req-806dbe08-cbed-4bb7-8e70-36110e921775 service nova] Creating event network-changed:cddb0d7e-7022-4a60-ba3b-4112336a886c for instance da017fd6-2861-4ef8-b216-cb16309cdf1b on hv-cinder-85427 Aug 24 07:55:57.301997 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-faf83a92-8054-4a9a-9061-bc8e7be92780 req-806dbe08-cbed-4bb7-8e70-36110e921775 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.650730 Aug 24 07:55:57.303888 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 33/59] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:55:57.312639 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-49189540-3312-46ba-9b55-88dfef771e5d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:57.313588 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-49189540-3312-46ba-9b55-88dfef771e5d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:57.320522 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-49189540-3312-46ba-9b55-88dfef771e5d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:57.321370 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-49189540-3312-46ba-9b55-88dfef771e5d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:57.322207 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-49189540-3312-46ba-9b55-88dfef771e5d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:57.323142 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-49189540-3312-46ba-9b55-88dfef771e5d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:57.323769 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-49189540-3312-46ba-9b55-88dfef771e5d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:57.325111 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-49189540-3312-46ba-9b55-88dfef771e5d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:57.332755 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-b47acf50-34d6-463e-bd6e-a48ee032a177 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:57.341137 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-b47acf50-34d6-463e-bd6e-a48ee032a177 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1314 microversion: 2.1 time: 0.430789 Aug 24 07:55:57.353037 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 27/60] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:56 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:57.638339 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-49189540-3312-46ba-9b55-88dfef771e5d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:57.646414 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-49189540-3312-46ba-9b55-88dfef771e5d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1322 microversion: 2.1 time: 0.341052 Aug 24 07:55:57.660798 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 34/61] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:57 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:57.908008 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-fe405c1b-822c-46ca-a63c-94e9d7469b2f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:57.909431 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-fe405c1b-822c-46ca-a63c-94e9d7469b2f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:57.918359 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fe405c1b-822c-46ca-a63c-94e9d7469b2f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:57.919279 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fe405c1b-822c-46ca-a63c-94e9d7469b2f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:57.919712 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fe405c1b-822c-46ca-a63c-94e9d7469b2f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:57.920560 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fe405c1b-822c-46ca-a63c-94e9d7469b2f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:57.921197 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fe405c1b-822c-46ca-a63c-94e9d7469b2f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:57.921814 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fe405c1b-822c-46ca-a63c-94e9d7469b2f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:58.101566 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-fe405c1b-822c-46ca-a63c-94e9d7469b2f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:58.113580 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-fe405c1b-822c-46ca-a63c-94e9d7469b2f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:58.115812 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-fe405c1b-822c-46ca-a63c-94e9d7469b2f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:58.118571 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-fe405c1b-822c-46ca-a63c-94e9d7469b2f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1407 microversion: 2.20 time: 0.215719 Aug 24 07:55:58.119772 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 28/62] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:55:57 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:55:58.375291 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b34169c6-53e5-4a4a-9564-5e2801dc9508 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:58.376059 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-b34169c6-53e5-4a4a-9564-5e2801dc9508 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:58.387613 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b34169c6-53e5-4a4a-9564-5e2801dc9508 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:58.391261 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b34169c6-53e5-4a4a-9564-5e2801dc9508 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:58.394126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b34169c6-53e5-4a4a-9564-5e2801dc9508 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:58.394126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b34169c6-53e5-4a4a-9564-5e2801dc9508 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:58.394126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b34169c6-53e5-4a4a-9564-5e2801dc9508 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:58.394126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b34169c6-53e5-4a4a-9564-5e2801dc9508 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:58.670159 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-17d4edb5-f3b9-455a-ba22-8d3d90831ab5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:58.670785 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-17d4edb5-f3b9-455a-ba22-8d3d90831ab5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:58.678274 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-17d4edb5-f3b9-455a-ba22-8d3d90831ab5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:58.678975 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-17d4edb5-f3b9-455a-ba22-8d3d90831ab5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:58.679566 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-17d4edb5-f3b9-455a-ba22-8d3d90831ab5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:58.680434 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-17d4edb5-f3b9-455a-ba22-8d3d90831ab5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:58.681631 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-17d4edb5-f3b9-455a-ba22-8d3d90831ab5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:58.682318 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-17d4edb5-f3b9-455a-ba22-8d3d90831ab5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:58.895058 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b34169c6-53e5-4a4a-9564-5e2801dc9508 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:58.905463 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-b34169c6-53e5-4a4a-9564-5e2801dc9508 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1314 microversion: 2.1 time: 0.533502 Aug 24 07:55:58.909750 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 35/63] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:58 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1314 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:58.915207 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-81d4e0b4-2abb-4f16-9060-f70d8e7e4ca2 req-78640e31-63a9-4a71-9e68-3c7c85bbe882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a266e179-03cc-40b3-902d-aab680174711", "tag": "45373581-1bd1-4a1b-aff0-a6e9993cd6b9"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:58.939342 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-81d4e0b4-2abb-4f16-9060-f70d8e7e4ca2 req-78640e31-63a9-4a71-9e68-3c7c85bbe882 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:58.940137 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-81d4e0b4-2abb-4f16-9060-f70d8e7e4ca2 req-78640e31-63a9-4a71-9e68-3c7c85bbe882 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:58.940756 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-81d4e0b4-2abb-4f16-9060-f70d8e7e4ca2 req-78640e31-63a9-4a71-9e68-3c7c85bbe882 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:58.966790 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-81d4e0b4-2abb-4f16-9060-f70d8e7e4ca2 req-78640e31-63a9-4a71-9e68-3c7c85bbe882 service nova] Creating event network-changed:45373581-1bd1-4a1b-aff0-a6e9993cd6b9 for instance a266e179-03cc-40b3-902d-aab680174711 on hv-cinder-85427 Aug 24 07:55:58.992516 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-81d4e0b4-2abb-4f16-9060-f70d8e7e4ca2 req-78640e31-63a9-4a71-9e68-3c7c85bbe882 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080788 Aug 24 07:55:58.996979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 36/64] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:55:59.142735 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-d93c2b3d-098b-4f16-9d14-0f646f8144bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:59.143507 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-d93c2b3d-098b-4f16-9d14-0f646f8144bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:59.153746 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d93c2b3d-098b-4f16-9d14-0f646f8144bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:59.157182 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d93c2b3d-098b-4f16-9d14-0f646f8144bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:59.157699 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d93c2b3d-098b-4f16-9d14-0f646f8144bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:59.159119 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d93c2b3d-098b-4f16-9d14-0f646f8144bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:59.161050 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d93c2b3d-098b-4f16-9d14-0f646f8144bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:59.161831 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d93c2b3d-098b-4f16-9d14-0f646f8144bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:59.302520 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-17d4edb5-f3b9-455a-ba22-8d3d90831ab5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:59.322123 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-17d4edb5-f3b9-455a-ba22-8d3d90831ab5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1322 microversion: 2.1 time: 0.658110 Aug 24 07:55:59.325389 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 29/65] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:58 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1322 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:59.334717 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-8cea2f93-8010-4e62-93be-38545fedc155 req-05344071-dafe-4054-ae79-f8694c730cec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f68297f-844b-4ab5-a37a-6bccb85cb78a", "tag": "49b68683-54d3-4b18-ac8e-682c0ebad5ee"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:55:59.363814 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-8cea2f93-8010-4e62-93be-38545fedc155 req-05344071-dafe-4054-ae79-f8694c730cec service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:59.365742 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-8cea2f93-8010-4e62-93be-38545fedc155 req-05344071-dafe-4054-ae79-f8694c730cec service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:59.367213 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-8cea2f93-8010-4e62-93be-38545fedc155 req-05344071-dafe-4054-ae79-f8694c730cec service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:59.525203 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-8cea2f93-8010-4e62-93be-38545fedc155 req-05344071-dafe-4054-ae79-f8694c730cec service nova] Creating event network-changed:49b68683-54d3-4b18-ac8e-682c0ebad5ee for instance 8f68297f-844b-4ab5-a37a-6bccb85cb78a on hv-cinder-85427 Aug 24 07:55:59.525203 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-8cea2f93-8010-4e62-93be-38545fedc155 req-05344071-dafe-4054-ae79-f8694c730cec service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127590) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 07:55:59.525203 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-8cea2f93-8010-4e62-93be-38545fedc155 req-05344071-dafe-4054-ae79-f8694c730cec service nova] Acquired lock "compute-rpcapi-router" {{(pid=127590) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 07:55:59.525203 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b7c428f1-c6e8-42e5-9c47-551315992a92 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:59.525203 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b7c428f1-c6e8-42e5-9c47-551315992a92 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:59.526169 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b7c428f1-c6e8-42e5-9c47-551315992a92 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:59.526169 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b7c428f1-c6e8-42e5-9c47-551315992a92 None None] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:59.526169 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b7c428f1-c6e8-42e5-9c47-551315992a92 None None] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:59.526169 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b7c428f1-c6e8-42e5-9c47-551315992a92 None None] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:59.526169 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.compute.rpcapi [None req-b7c428f1-c6e8-42e5-9c47-551315992a92 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 07:55:59.527567 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b7c428f1-c6e8-42e5-9c47-551315992a92 None None] Releasing lock "compute-rpcapi-router" {{(pid=127590) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 07:55:59.527567 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-b7c428f1-c6e8-42e5-9c47-551315992a92 None None] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167520 Aug 24 07:55:59.527567 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 30/66] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:55:59.907810 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-d93c2b3d-098b-4f16-9d14-0f646f8144bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:59.916594 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-d93c2b3d-098b-4f16-9d14-0f646f8144bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:59.927355 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-d93c2b3d-098b-4f16-9d14-0f646f8144bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:59.929209 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-d93c2b3d-098b-4f16-9d14-0f646f8144bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1407 microversion: 2.20 time: 0.790810 Aug 24 07:55:59.936778 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-32ec1623-d238-4f6a-b7ef-14f83d63da55 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:59.947537 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-32ec1623-d238-4f6a-b7ef-14f83d63da55 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:59.947805 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 37/67] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:55:59 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1407 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:55:59.947908 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-32ec1623-d238-4f6a-b7ef-14f83d63da55 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:59.947908 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-32ec1623-d238-4f6a-b7ef-14f83d63da55 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:59.947908 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-32ec1623-d238-4f6a-b7ef-14f83d63da55 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:59.947908 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-32ec1623-d238-4f6a-b7ef-14f83d63da55 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:59.948336 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-32ec1623-d238-4f6a-b7ef-14f83d63da55 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:59.948336 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-32ec1623-d238-4f6a-b7ef-14f83d63da55 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:00.344204 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-4fc90324-ed5f-4b4d-80b5-987a5ee21a92 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:00.344878 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-4fc90324-ed5f-4b4d-80b5-987a5ee21a92 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:00.358403 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4fc90324-ed5f-4b4d-80b5-987a5ee21a92 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:00.358899 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4fc90324-ed5f-4b4d-80b5-987a5ee21a92 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:00.359335 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4fc90324-ed5f-4b4d-80b5-987a5ee21a92 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:00.360050 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4fc90324-ed5f-4b4d-80b5-987a5ee21a92 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:00.360487 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4fc90324-ed5f-4b4d-80b5-987a5ee21a92 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:00.361112 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4fc90324-ed5f-4b4d-80b5-987a5ee21a92 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:00.750764 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-32ec1623-d238-4f6a-b7ef-14f83d63da55 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:00.768573 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-32ec1623-d238-4f6a-b7ef-14f83d63da55 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1314 microversion: 2.1 time: 0.834976 Aug 24 07:56:00.771624 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 31/68] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:59 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1314 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:00.826394 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-4fc90324-ed5f-4b4d-80b5-987a5ee21a92 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:00.842533 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-4fc90324-ed5f-4b4d-80b5-987a5ee21a92 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1322 microversion: 2.1 time: 0.500827 Aug 24 07:56:00.848375 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 38/69] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:00 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1322 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:00.958113 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-28045ab2-6ef8-4a08-a69b-5adeac3709bf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:00.958961 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-28045ab2-6ef8-4a08-a69b-5adeac3709bf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:00.967589 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-28045ab2-6ef8-4a08-a69b-5adeac3709bf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:00.968075 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-28045ab2-6ef8-4a08-a69b-5adeac3709bf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:00.968505 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-28045ab2-6ef8-4a08-a69b-5adeac3709bf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:00.970428 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-28045ab2-6ef8-4a08-a69b-5adeac3709bf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:00.970890 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-28045ab2-6ef8-4a08-a69b-5adeac3709bf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:00.971330 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-28045ab2-6ef8-4a08-a69b-5adeac3709bf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:01.243848 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-28045ab2-6ef8-4a08-a69b-5adeac3709bf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:01.255539 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-28045ab2-6ef8-4a08-a69b-5adeac3709bf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:01.257663 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-28045ab2-6ef8-4a08-a69b-5adeac3709bf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:01.259467 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-28045ab2-6ef8-4a08-a69b-5adeac3709bf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1407 microversion: 2.20 time: 0.304872 Aug 24 07:56:01.276684 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 32/70] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:56:00 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1407 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:56:01.795667 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-c6716916-f49e-4d75-ad07-55d9e1881725 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:01.797164 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-c6716916-f49e-4d75-ad07-55d9e1881725 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:01.810431 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c6716916-f49e-4d75-ad07-55d9e1881725 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:01.811220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c6716916-f49e-4d75-ad07-55d9e1881725 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:01.811995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c6716916-f49e-4d75-ad07-55d9e1881725 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:01.812971 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c6716916-f49e-4d75-ad07-55d9e1881725 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:01.813500 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c6716916-f49e-4d75-ad07-55d9e1881725 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:01.814162 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c6716916-f49e-4d75-ad07-55d9e1881725 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:01.869269 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-3950f34a-bdf1-4c19-b2cc-ca55cd64f39d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:01.872456 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-3950f34a-bdf1-4c19-b2cc-ca55cd64f39d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:01.877890 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3950f34a-bdf1-4c19-b2cc-ca55cd64f39d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:01.878631 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3950f34a-bdf1-4c19-b2cc-ca55cd64f39d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:01.879648 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3950f34a-bdf1-4c19-b2cc-ca55cd64f39d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:01.881755 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3950f34a-bdf1-4c19-b2cc-ca55cd64f39d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:01.882412 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3950f34a-bdf1-4c19-b2cc-ca55cd64f39d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:01.883124 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3950f34a-bdf1-4c19-b2cc-ca55cd64f39d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:02.001174 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-c6716916-f49e-4d75-ad07-55d9e1881725 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:02.011118 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-c6716916-f49e-4d75-ad07-55d9e1881725 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1314 microversion: 2.1 time: 0.221958 Aug 24 07:56:02.012487 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 39/71] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:01 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:02.152862 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-3950f34a-bdf1-4c19-b2cc-ca55cd64f39d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:02.167606 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-3950f34a-bdf1-4c19-b2cc-ca55cd64f39d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1322 microversion: 2.1 time: 0.302581 Aug 24 07:56:02.168196 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 33/72] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:01 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:02.286436 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e963058c-9b11-4566-b69b-331c6881f02b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:02.287327 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-e963058c-9b11-4566-b69b-331c6881f02b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:02.305515 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e963058c-9b11-4566-b69b-331c6881f02b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:02.306017 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e963058c-9b11-4566-b69b-331c6881f02b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:02.306537 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e963058c-9b11-4566-b69b-331c6881f02b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:02.307240 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e963058c-9b11-4566-b69b-331c6881f02b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:02.307974 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e963058c-9b11-4566-b69b-331c6881f02b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:02.314645 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e963058c-9b11-4566-b69b-331c6881f02b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:02.349600 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=100 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:02.584194 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e963058c-9b11-4566-b69b-331c6881f02b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:02.596554 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e963058c-9b11-4566-b69b-331c6881f02b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:02.598788 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e963058c-9b11-4566-b69b-331c6881f02b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:02.600562 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-e963058c-9b11-4566-b69b-331c6881f02b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1407 microversion: 2.20 time: 0.322066 Aug 24 07:56:02.601469 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 40/73] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:56:02 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1407 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:56:03.032109 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-43a11711-2c27-49f7-a030-cde5512f8bce tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:03.032898 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-43a11711-2c27-49f7-a030-cde5512f8bce tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:03.039252 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-43a11711-2c27-49f7-a030-cde5512f8bce tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:03.039734 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-43a11711-2c27-49f7-a030-cde5512f8bce tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:03.040167 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-43a11711-2c27-49f7-a030-cde5512f8bce tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:03.040899 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-43a11711-2c27-49f7-a030-cde5512f8bce tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:03.041350 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-43a11711-2c27-49f7-a030-cde5512f8bce tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:03.042356 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-43a11711-2c27-49f7-a030-cde5512f8bce tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:03.047521 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=100 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:03.192263 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-3dd2ba72-5541-42a0-a96f-16ed713ee035 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:03.192901 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-3dd2ba72-5541-42a0-a96f-16ed713ee035 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:03.207774 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3dd2ba72-5541-42a0-a96f-16ed713ee035 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:03.207774 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3dd2ba72-5541-42a0-a96f-16ed713ee035 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:03.207774 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3dd2ba72-5541-42a0-a96f-16ed713ee035 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:03.211030 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3dd2ba72-5541-42a0-a96f-16ed713ee035 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:03.212771 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3dd2ba72-5541-42a0-a96f-16ed713ee035 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:03.214678 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3dd2ba72-5541-42a0-a96f-16ed713ee035 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:03.247370 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-43a11711-2c27-49f7-a030-cde5512f8bce tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:03.261584 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-43a11711-2c27-49f7-a030-cde5512f8bce tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1314 microversion: 2.1 time: 0.232129 Aug 24 07:56:03.279586 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 34/74] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:03 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:03.464626 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-3dd2ba72-5541-42a0-a96f-16ed713ee035 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:03.476669 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-3dd2ba72-5541-42a0-a96f-16ed713ee035 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1322 microversion: 2.1 time: 0.287006 Aug 24 07:56:03.476669 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 41/75] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:03 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:03.625226 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-7d3aa89c-7457-485f-bf71-4804499a80bc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:03.626477 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-7d3aa89c-7457-485f-bf71-4804499a80bc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:03.634486 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:03.634847 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d3aa89c-7457-485f-bf71-4804499a80bc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:03.636104 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d3aa89c-7457-485f-bf71-4804499a80bc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:03.636901 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d3aa89c-7457-485f-bf71-4804499a80bc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:03.637672 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d3aa89c-7457-485f-bf71-4804499a80bc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:03.638499 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d3aa89c-7457-485f-bf71-4804499a80bc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:03.639181 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d3aa89c-7457-485f-bf71-4804499a80bc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:03.817669 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-7d3aa89c-7457-485f-bf71-4804499a80bc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:03.828085 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-7d3aa89c-7457-485f-bf71-4804499a80bc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:03.830225 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-7d3aa89c-7457-485f-bf71-4804499a80bc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:03.831718 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-7d3aa89c-7457-485f-bf71-4804499a80bc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1407 microversion: 2.20 time: 0.210512 Aug 24 07:56:03.832459 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 35/76] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:56:03 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:56:04.286867 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-673279e7-aaeb-47a6-9cca-2a27c8366646 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:04.287789 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-673279e7-aaeb-47a6-9cca-2a27c8366646 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:04.297481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-673279e7-aaeb-47a6-9cca-2a27c8366646 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:04.297481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-673279e7-aaeb-47a6-9cca-2a27c8366646 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:04.297481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-673279e7-aaeb-47a6-9cca-2a27c8366646 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:04.297481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-673279e7-aaeb-47a6-9cca-2a27c8366646 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:04.297786 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-673279e7-aaeb-47a6-9cca-2a27c8366646 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:04.297786 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-673279e7-aaeb-47a6-9cca-2a27c8366646 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:04.496282 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-2a51d4c7-5d9e-4ea0-a2ed-e3cc59ff7c9a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:04.496931 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-2a51d4c7-5d9e-4ea0-a2ed-e3cc59ff7c9a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:04.504346 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2a51d4c7-5d9e-4ea0-a2ed-e3cc59ff7c9a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:04.507323 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2a51d4c7-5d9e-4ea0-a2ed-e3cc59ff7c9a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:04.507323 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2a51d4c7-5d9e-4ea0-a2ed-e3cc59ff7c9a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:04.507323 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2a51d4c7-5d9e-4ea0-a2ed-e3cc59ff7c9a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:04.507323 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2a51d4c7-5d9e-4ea0-a2ed-e3cc59ff7c9a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:04.508084 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2a51d4c7-5d9e-4ea0-a2ed-e3cc59ff7c9a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:04.542866 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-673279e7-aaeb-47a6-9cca-2a27c8366646 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:04.550843 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-673279e7-aaeb-47a6-9cca-2a27c8366646 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1314 microversion: 2.1 time: 0.267873 Aug 24 07:56:04.551502 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 42/77] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:04 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:04.686583 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-2a51d4c7-5d9e-4ea0-a2ed-e3cc59ff7c9a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:04.695051 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-2a51d4c7-5d9e-4ea0-a2ed-e3cc59ff7c9a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1322 microversion: 2.1 time: 0.203651 Aug 24 07:56:04.696179 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 36/78] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:04 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:04.855927 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-cf6cc44d-af82-4411-9b2f-acc0deaebf21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:04.856795 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-cf6cc44d-af82-4411-9b2f-acc0deaebf21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:04.863424 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cf6cc44d-af82-4411-9b2f-acc0deaebf21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:04.864062 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cf6cc44d-af82-4411-9b2f-acc0deaebf21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:04.864500 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cf6cc44d-af82-4411-9b2f-acc0deaebf21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:04.865264 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cf6cc44d-af82-4411-9b2f-acc0deaebf21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:04.865726 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cf6cc44d-af82-4411-9b2f-acc0deaebf21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:04.866598 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cf6cc44d-af82-4411-9b2f-acc0deaebf21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:05.049397 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-cf6cc44d-af82-4411-9b2f-acc0deaebf21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:05.060318 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-cf6cc44d-af82-4411-9b2f-acc0deaebf21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:05.061984 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-cf6cc44d-af82-4411-9b2f-acc0deaebf21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:05.063327 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-cf6cc44d-af82-4411-9b2f-acc0deaebf21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1407 microversion: 2.20 time: 0.212419 Aug 24 07:56:05.065854 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 43/79] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:56:04 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:56:05.579436 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-b951d7f2-8871-4f13-a1e7-b1647addc8cf tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:05.581421 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-b951d7f2-8871-4f13-a1e7-b1647addc8cf tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:05.589725 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b951d7f2-8871-4f13-a1e7-b1647addc8cf tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:05.590433 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b951d7f2-8871-4f13-a1e7-b1647addc8cf tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:05.591379 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b951d7f2-8871-4f13-a1e7-b1647addc8cf tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:05.592569 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b951d7f2-8871-4f13-a1e7-b1647addc8cf tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:05.593223 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b951d7f2-8871-4f13-a1e7-b1647addc8cf tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:05.593833 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b951d7f2-8871-4f13-a1e7-b1647addc8cf tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:05.718509 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-068e0a7c-56fc-4251-bd2f-f48fdbec2174 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:05.719755 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-068e0a7c-56fc-4251-bd2f-f48fdbec2174 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:05.726189 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:05.728004 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-068e0a7c-56fc-4251-bd2f-f48fdbec2174 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:05.728800 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-068e0a7c-56fc-4251-bd2f-f48fdbec2174 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:05.729941 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-068e0a7c-56fc-4251-bd2f-f48fdbec2174 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:05.731396 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-068e0a7c-56fc-4251-bd2f-f48fdbec2174 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:05.732018 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-068e0a7c-56fc-4251-bd2f-f48fdbec2174 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:05.732612 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-068e0a7c-56fc-4251-bd2f-f48fdbec2174 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:05.883412 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-b951d7f2-8871-4f13-a1e7-b1647addc8cf tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:05.892926 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-b951d7f2-8871-4f13-a1e7-b1647addc8cf tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1314 microversion: 2.1 time: 0.321435 Aug 24 07:56:05.893638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 37/80] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:05 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:05.921318 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-068e0a7c-56fc-4251-bd2f-f48fdbec2174 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:05.929734 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-068e0a7c-56fc-4251-bd2f-f48fdbec2174 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1322 microversion: 2.1 time: 0.215370 Aug 24 07:56:05.930593 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 44/81] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:05 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:06.092236 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-62099620-595b-4b05-8d66-fb2aaafda708 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:06.093521 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-62099620-595b-4b05-8d66-fb2aaafda708 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:06.106075 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-62099620-595b-4b05-8d66-fb2aaafda708 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:06.106566 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-62099620-595b-4b05-8d66-fb2aaafda708 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:06.106987 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-62099620-595b-4b05-8d66-fb2aaafda708 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:06.108029 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-62099620-595b-4b05-8d66-fb2aaafda708 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:06.108618 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-62099620-595b-4b05-8d66-fb2aaafda708 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:06.109203 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-62099620-595b-4b05-8d66-fb2aaafda708 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:06.325461 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-62099620-595b-4b05-8d66-fb2aaafda708 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:06.340378 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-62099620-595b-4b05-8d66-fb2aaafda708 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:06.343591 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-62099620-595b-4b05-8d66-fb2aaafda708 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:06.345686 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-62099620-595b-4b05-8d66-fb2aaafda708 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1407 microversion: 2.20 time: 0.258670 Aug 24 07:56:06.347250 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 38/82] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:56:06 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:56:06.914433 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-fd9c1169-d5f9-41b1-9e33-5876d6eefd35 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:06.915212 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-fd9c1169-d5f9-41b1-9e33-5876d6eefd35 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:06.922679 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=2 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:06.927370 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fd9c1169-d5f9-41b1-9e33-5876d6eefd35 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:06.928943 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fd9c1169-d5f9-41b1-9e33-5876d6eefd35 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:06.929508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fd9c1169-d5f9-41b1-9e33-5876d6eefd35 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:06.931311 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fd9c1169-d5f9-41b1-9e33-5876d6eefd35 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:06.932770 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fd9c1169-d5f9-41b1-9e33-5876d6eefd35 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:06.933434 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fd9c1169-d5f9-41b1-9e33-5876d6eefd35 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:06.952279 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-9062b2c3-4925-4c5e-a03f-b061f56f9869 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:06.953645 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-9062b2c3-4925-4c5e-a03f-b061f56f9869 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:06.967126 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9062b2c3-4925-4c5e-a03f-b061f56f9869 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:06.969235 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9062b2c3-4925-4c5e-a03f-b061f56f9869 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:06.969951 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9062b2c3-4925-4c5e-a03f-b061f56f9869 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:06.974688 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9062b2c3-4925-4c5e-a03f-b061f56f9869 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:06.975369 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9062b2c3-4925-4c5e-a03f-b061f56f9869 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:06.975886 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9062b2c3-4925-4c5e-a03f-b061f56f9869 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:07.137121 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9062b2c3-4925-4c5e-a03f-b061f56f9869 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:07.146231 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-9062b2c3-4925-4c5e-a03f-b061f56f9869 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1322 microversion: 2.1 time: 0.198310 Aug 24 07:56:07.146877 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 39/83] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:06 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:07.154147 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-fd9c1169-d5f9-41b1-9e33-5876d6eefd35 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:07.165062 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-fd9c1169-d5f9-41b1-9e33-5876d6eefd35 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1314 microversion: 2.1 time: 0.254858 Aug 24 07:56:07.166005 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 45/84] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:06 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:07.382970 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-95d9b765-0182-462a-b218-b9e4188b6fac tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:07.383522 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-95d9b765-0182-462a-b218-b9e4188b6fac tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:07.390796 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-95d9b765-0182-462a-b218-b9e4188b6fac tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:07.391285 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-95d9b765-0182-462a-b218-b9e4188b6fac tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:07.391716 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-95d9b765-0182-462a-b218-b9e4188b6fac tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:07.392419 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-95d9b765-0182-462a-b218-b9e4188b6fac tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:07.392911 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-95d9b765-0182-462a-b218-b9e4188b6fac tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:07.393336 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-95d9b765-0182-462a-b218-b9e4188b6fac tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:07.530185 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-95d9b765-0182-462a-b218-b9e4188b6fac tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:07.539157 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-95d9b765-0182-462a-b218-b9e4188b6fac tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:07.540801 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-95d9b765-0182-462a-b218-b9e4188b6fac tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:07.542017 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-95d9b765-0182-462a-b218-b9e4188b6fac tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1407 microversion: 2.20 time: 0.163289 Aug 24 07:56:07.542646 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 40/85] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:56:07 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:56:08.171374 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-319ca682-d06b-4e13-9675-8c5d56250179 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:08.172890 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-319ca682-d06b-4e13-9675-8c5d56250179 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:08.180892 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-319ca682-d06b-4e13-9675-8c5d56250179 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:08.181715 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-319ca682-d06b-4e13-9675-8c5d56250179 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:08.182810 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-319ca682-d06b-4e13-9675-8c5d56250179 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:08.183693 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-319ca682-d06b-4e13-9675-8c5d56250179 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:08.184341 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-319ca682-d06b-4e13-9675-8c5d56250179 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:08.184811 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-319ca682-d06b-4e13-9675-8c5d56250179 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:08.187928 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-ff7fa6a8-e8c8-4281-add6-31e345bf820a tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:08.189015 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-ff7fa6a8-e8c8-4281-add6-31e345bf820a tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:08.197019 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ff7fa6a8-e8c8-4281-add6-31e345bf820a tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:08.197652 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ff7fa6a8-e8c8-4281-add6-31e345bf820a tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:08.198178 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ff7fa6a8-e8c8-4281-add6-31e345bf820a tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:08.199244 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ff7fa6a8-e8c8-4281-add6-31e345bf820a tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:08.204762 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ff7fa6a8-e8c8-4281-add6-31e345bf820a tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:08.205303 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ff7fa6a8-e8c8-4281-add6-31e345bf820a tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:08.341531 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-319ca682-d06b-4e13-9675-8c5d56250179 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:08.349361 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-319ca682-d06b-4e13-9675-8c5d56250179 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1322 microversion: 2.1 time: 0.182751 Aug 24 07:56:08.350014 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 46/86] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:08 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:08.355562 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-ff7fa6a8-e8c8-4281-add6-31e345bf820a tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:08.371926 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-ff7fa6a8-e8c8-4281-add6-31e345bf820a tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1314 microversion: 2.1 time: 0.189279 Aug 24 07:56:08.372513 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 41/87] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:08 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:08.568308 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b7c9362c-30bb-4cdd-b545-615403c256d6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:08.568978 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-b7c9362c-30bb-4cdd-b545-615403c256d6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:08.575082 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b7c9362c-30bb-4cdd-b545-615403c256d6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:08.575566 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b7c9362c-30bb-4cdd-b545-615403c256d6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:08.576002 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b7c9362c-30bb-4cdd-b545-615403c256d6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:08.576727 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b7c9362c-30bb-4cdd-b545-615403c256d6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:08.577180 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b7c9362c-30bb-4cdd-b545-615403c256d6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:08.577607 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b7c9362c-30bb-4cdd-b545-615403c256d6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:08.720912 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b7c9362c-30bb-4cdd-b545-615403c256d6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:08.730018 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b7c9362c-30bb-4cdd-b545-615403c256d6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:08.737193 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b7c9362c-30bb-4cdd-b545-615403c256d6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:08.737193 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-b7c9362c-30bb-4cdd-b545-615403c256d6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1407 microversion: 2.20 time: 0.168309 Aug 24 07:56:08.737193 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 47/88] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:56:08 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:56:09.373202 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-1f36929a-a1f2-4607-aed6-5f560548aff0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:09.374213 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-1f36929a-a1f2-4607-aed6-5f560548aff0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:09.381136 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1f36929a-a1f2-4607-aed6-5f560548aff0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:09.381798 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1f36929a-a1f2-4607-aed6-5f560548aff0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:09.382226 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1f36929a-a1f2-4607-aed6-5f560548aff0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:09.386578 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1f36929a-a1f2-4607-aed6-5f560548aff0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:09.387274 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1f36929a-a1f2-4607-aed6-5f560548aff0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:09.387955 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1f36929a-a1f2-4607-aed6-5f560548aff0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:09.392309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-bf423cb2-7863-4b03-a01d-8aba9bf56608 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:09.394307 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-bf423cb2-7863-4b03-a01d-8aba9bf56608 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:09.407232 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bf423cb2-7863-4b03-a01d-8aba9bf56608 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:09.408045 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bf423cb2-7863-4b03-a01d-8aba9bf56608 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:09.408163 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bf423cb2-7863-4b03-a01d-8aba9bf56608 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:09.408871 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bf423cb2-7863-4b03-a01d-8aba9bf56608 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:09.409321 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bf423cb2-7863-4b03-a01d-8aba9bf56608 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:09.409743 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bf423cb2-7863-4b03-a01d-8aba9bf56608 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:09.453297 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=2 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:09.539706 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-1f36929a-a1f2-4607-aed6-5f560548aff0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:09.549934 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-1f36929a-a1f2-4607-aed6-5f560548aff0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1322 microversion: 2.1 time: 0.182581 Aug 24 07:56:09.550908 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 42/89] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:09 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:09.580014 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-bf423cb2-7863-4b03-a01d-8aba9bf56608 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:09.590258 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-bf423cb2-7863-4b03-a01d-8aba9bf56608 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1314 microversion: 2.1 time: 0.201689 Aug 24 07:56:09.591441 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 48/90] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:09 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:09.755385 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-4e89ad67-6b84-455d-99ef-63a4822b07e7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:09.755998 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-4e89ad67-6b84-455d-99ef-63a4822b07e7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:09.764371 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4e89ad67-6b84-455d-99ef-63a4822b07e7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:09.764829 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4e89ad67-6b84-455d-99ef-63a4822b07e7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:09.765261 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4e89ad67-6b84-455d-99ef-63a4822b07e7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:09.765957 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4e89ad67-6b84-455d-99ef-63a4822b07e7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:09.766442 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4e89ad67-6b84-455d-99ef-63a4822b07e7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:09.766955 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4e89ad67-6b84-455d-99ef-63a4822b07e7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:09.925479 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-4e89ad67-6b84-455d-99ef-63a4822b07e7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:09.935110 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-4e89ad67-6b84-455d-99ef-63a4822b07e7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:09.937720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-4e89ad67-6b84-455d-99ef-63a4822b07e7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:09.938851 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-4e89ad67-6b84-455d-99ef-63a4822b07e7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1407 microversion: 2.20 time: 0.187311 Aug 24 07:56:09.939415 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 43/91] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:56:09 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:56:10.572225 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-4ff986ef-8343-4b2d-ab78-7e81498918f9 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:10.573746 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-4ff986ef-8343-4b2d-ab78-7e81498918f9 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:10.585617 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4ff986ef-8343-4b2d-ab78-7e81498918f9 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:10.587170 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4ff986ef-8343-4b2d-ab78-7e81498918f9 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:10.587756 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4ff986ef-8343-4b2d-ab78-7e81498918f9 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:10.588715 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4ff986ef-8343-4b2d-ab78-7e81498918f9 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:10.589460 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4ff986ef-8343-4b2d-ab78-7e81498918f9 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:10.590909 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4ff986ef-8343-4b2d-ab78-7e81498918f9 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:10.693573 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-29b565e9-d0be-4f2d-bf7a-55735ba98ea2 req-17685bd0-dcf1-4b77-94ee-59b7a7b88573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da017fd6-2861-4ef8-b216-cb16309cdf1b", "name": "network-vif-plugged", "status": "completed", "tag": "cddb0d7e-7022-4a60-ba3b-4112336a886c"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:56:10.707594 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-29b565e9-d0be-4f2d-bf7a-55735ba98ea2 req-17685bd0-dcf1-4b77-94ee-59b7a7b88573 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:10.708298 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-29b565e9-d0be-4f2d-bf7a-55735ba98ea2 req-17685bd0-dcf1-4b77-94ee-59b7a7b88573 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:10.708915 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-29b565e9-d0be-4f2d-bf7a-55735ba98ea2 req-17685bd0-dcf1-4b77-94ee-59b7a7b88573 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:10.725301 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-29b565e9-d0be-4f2d-bf7a-55735ba98ea2 req-17685bd0-dcf1-4b77-94ee-59b7a7b88573 service nova] Creating event network-vif-plugged:cddb0d7e-7022-4a60-ba3b-4112336a886c for instance da017fd6-2861-4ef8-b216-cb16309cdf1b on hv-cinder-85427 Aug 24 07:56:10.731843 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-29b565e9-d0be-4f2d-bf7a-55735ba98ea2 req-17685bd0-dcf1-4b77-94ee-59b7a7b88573 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.370080 Aug 24 07:56:10.733214 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 49/92] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:56:10.750587 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-561bfe71-c6df-46ad-b216-71a116e3080f tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:10.751370 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-561bfe71-c6df-46ad-b216-71a116e3080f tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:10.760032 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-561bfe71-c6df-46ad-b216-71a116e3080f tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:10.760535 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-561bfe71-c6df-46ad-b216-71a116e3080f tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:10.761005 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-561bfe71-c6df-46ad-b216-71a116e3080f tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:10.761724 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-561bfe71-c6df-46ad-b216-71a116e3080f tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:10.762177 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-561bfe71-c6df-46ad-b216-71a116e3080f tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:10.763650 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-561bfe71-c6df-46ad-b216-71a116e3080f tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:10.881243 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-4ff986ef-8343-4b2d-ab78-7e81498918f9 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:10.890282 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-4ff986ef-8343-4b2d-ab78-7e81498918f9 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1322 microversion: 2.1 time: 0.321923 Aug 24 07:56:10.891794 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 44/93] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:10 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:10.962420 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-7877f369-c362-4e92-91d5-230abd6fbb92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:10.964229 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-7877f369-c362-4e92-91d5-230abd6fbb92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:10.976670 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7877f369-c362-4e92-91d5-230abd6fbb92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:10.977423 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7877f369-c362-4e92-91d5-230abd6fbb92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:10.978003 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7877f369-c362-4e92-91d5-230abd6fbb92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:10.978642 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7877f369-c362-4e92-91d5-230abd6fbb92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:10.979825 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7877f369-c362-4e92-91d5-230abd6fbb92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:10.982983 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7877f369-c362-4e92-91d5-230abd6fbb92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:11.075733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-561bfe71-c6df-46ad-b216-71a116e3080f tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:11.087869 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-561bfe71-c6df-46ad-b216-71a116e3080f tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1314 microversion: 2.1 time: 0.352773 Aug 24 07:56:11.098892 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 50/94] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:10 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:11.414588 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-7877f369-c362-4e92-91d5-230abd6fbb92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:11.430237 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-7877f369-c362-4e92-91d5-230abd6fbb92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:11.434423 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-7877f369-c362-4e92-91d5-230abd6fbb92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:11.436290 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-7877f369-c362-4e92-91d5-230abd6fbb92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1407 microversion: 2.20 time: 0.477636 Aug 24 07:56:11.438317 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 45/95] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:56:10 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1407 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:56:11.916736 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-331361e4-b03c-4675-8a73-df48a7d90912 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:11.917601 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-331361e4-b03c-4675-8a73-df48a7d90912 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:11.924739 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-331361e4-b03c-4675-8a73-df48a7d90912 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:11.925302 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-331361e4-b03c-4675-8a73-df48a7d90912 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:11.925803 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-331361e4-b03c-4675-8a73-df48a7d90912 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:11.926610 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-331361e4-b03c-4675-8a73-df48a7d90912 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:11.927154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-331361e4-b03c-4675-8a73-df48a7d90912 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:11.927767 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-331361e4-b03c-4675-8a73-df48a7d90912 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:12.064368 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-331361e4-b03c-4675-8a73-df48a7d90912 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:12.072435 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-331361e4-b03c-4675-8a73-df48a7d90912 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1322 microversion: 2.1 time: 0.160750 Aug 24 07:56:12.084600 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 51/96] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:11 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:12.116460 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-5bde4621-bcde-4002-a801-2d879d757e7f tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:12.117380 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-5bde4621-bcde-4002-a801-2d879d757e7f tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:12.124489 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5bde4621-bcde-4002-a801-2d879d757e7f tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:12.125160 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5bde4621-bcde-4002-a801-2d879d757e7f tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:12.125597 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5bde4621-bcde-4002-a801-2d879d757e7f tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:12.126299 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5bde4621-bcde-4002-a801-2d879d757e7f tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:12.126887 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5bde4621-bcde-4002-a801-2d879d757e7f tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:12.127239 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5bde4621-bcde-4002-a801-2d879d757e7f tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:12.272750 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-5bde4621-bcde-4002-a801-2d879d757e7f tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:12.284823 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-5bde4621-bcde-4002-a801-2d879d757e7f tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1314 microversion: 2.1 time: 0.177989 Aug 24 07:56:12.286884 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 46/97] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:12 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:12.462788 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-1ccc257e-447b-446d-a611-c174688b0508 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:12.463436 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-1ccc257e-447b-446d-a611-c174688b0508 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:12.483031 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1ccc257e-447b-446d-a611-c174688b0508 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:12.483988 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1ccc257e-447b-446d-a611-c174688b0508 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:12.484613 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1ccc257e-447b-446d-a611-c174688b0508 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:12.485555 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1ccc257e-447b-446d-a611-c174688b0508 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:12.486154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1ccc257e-447b-446d-a611-c174688b0508 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:12.486770 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1ccc257e-447b-446d-a611-c174688b0508 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:12.666929 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-1ccc257e-447b-446d-a611-c174688b0508 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:12.675410 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-1ccc257e-447b-446d-a611-c174688b0508 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:12.677121 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-1ccc257e-447b-446d-a611-c174688b0508 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:12.678421 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-1ccc257e-447b-446d-a611-c174688b0508 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1407 microversion: 2.20 time: 0.220862 Aug 24 07:56:12.679154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 52/98] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:56:12 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:56:12.748066 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-9beebee3-e61b-40bd-adbd-bafa7299db82 req-aad0a67b-9455-447d-9b8d-96b6d170cf0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a266e179-03cc-40b3-902d-aab680174711", "name": "network-vif-plugged", "status": "completed", "tag": "45373581-1bd1-4a1b-aff0-a6e9993cd6b9"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:56:12.758381 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-9beebee3-e61b-40bd-adbd-bafa7299db82 req-aad0a67b-9455-447d-9b8d-96b6d170cf0f service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:12.759026 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-9beebee3-e61b-40bd-adbd-bafa7299db82 req-aad0a67b-9455-447d-9b8d-96b6d170cf0f service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:12.759559 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-9beebee3-e61b-40bd-adbd-bafa7299db82 req-aad0a67b-9455-447d-9b8d-96b6d170cf0f service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:12.772256 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-9beebee3-e61b-40bd-adbd-bafa7299db82 req-aad0a67b-9455-447d-9b8d-96b6d170cf0f service nova] Creating event network-vif-plugged:45373581-1bd1-4a1b-aff0-a6e9993cd6b9 for instance a266e179-03cc-40b3-902d-aab680174711 on hv-cinder-85427 Aug 24 07:56:12.777513 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-9beebee3-e61b-40bd-adbd-bafa7299db82 req-aad0a67b-9455-447d-9b8d-96b6d170cf0f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034715 Aug 24 07:56:12.778194 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 47/99] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:56:13.093650 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-8d6bcf54-b1a1-4657-956b-c33d62d7f5d7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:13.095208 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-8d6bcf54-b1a1-4657-956b-c33d62d7f5d7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:13.103042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8d6bcf54-b1a1-4657-956b-c33d62d7f5d7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:13.104487 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8d6bcf54-b1a1-4657-956b-c33d62d7f5d7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:13.105497 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8d6bcf54-b1a1-4657-956b-c33d62d7f5d7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:13.106844 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8d6bcf54-b1a1-4657-956b-c33d62d7f5d7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:13.107601 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8d6bcf54-b1a1-4657-956b-c33d62d7f5d7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:13.108413 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8d6bcf54-b1a1-4657-956b-c33d62d7f5d7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:13.313853 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-8ddf61ee-0f8c-4edc-85e7-363725305966 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:13.315265 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-8ddf61ee-0f8c-4edc-85e7-363725305966 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:13.324473 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8ddf61ee-0f8c-4edc-85e7-363725305966 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:13.325027 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8ddf61ee-0f8c-4edc-85e7-363725305966 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:13.325614 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8ddf61ee-0f8c-4edc-85e7-363725305966 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:13.326353 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8ddf61ee-0f8c-4edc-85e7-363725305966 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:13.326802 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8ddf61ee-0f8c-4edc-85e7-363725305966 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:13.327380 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8ddf61ee-0f8c-4edc-85e7-363725305966 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:13.371306 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-8d6bcf54-b1a1-4657-956b-c33d62d7f5d7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:13.380524 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-8d6bcf54-b1a1-4657-956b-c33d62d7f5d7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1322 microversion: 2.1 time: 0.291116 Aug 24 07:56:13.381616 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 53/100] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:13 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:13.563020 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-8ddf61ee-0f8c-4edc-85e7-363725305966 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:13.574442 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-8ddf61ee-0f8c-4edc-85e7-363725305966 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1314 microversion: 2.1 time: 0.266495 Aug 24 07:56:13.578194 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 48/101] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:13 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:13.701920 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e6cdc504-e3b6-4f76-bcda-02ca7c1c7f80 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:13.702536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-e6cdc504-e3b6-4f76-bcda-02ca7c1c7f80 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:13.708371 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e6cdc504-e3b6-4f76-bcda-02ca7c1c7f80 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:13.709806 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e6cdc504-e3b6-4f76-bcda-02ca7c1c7f80 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:13.709806 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e6cdc504-e3b6-4f76-bcda-02ca7c1c7f80 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:13.710003 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e6cdc504-e3b6-4f76-bcda-02ca7c1c7f80 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:13.710440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e6cdc504-e3b6-4f76-bcda-02ca7c1c7f80 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:13.710870 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e6cdc504-e3b6-4f76-bcda-02ca7c1c7f80 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:13.860553 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e6cdc504-e3b6-4f76-bcda-02ca7c1c7f80 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:13.868831 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e6cdc504-e3b6-4f76-bcda-02ca7c1c7f80 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:13.870394 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e6cdc504-e3b6-4f76-bcda-02ca7c1c7f80 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:13.871588 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-e6cdc504-e3b6-4f76-bcda-02ca7c1c7f80 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1407 microversion: 2.20 time: 0.173669 Aug 24 07:56:13.872152 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 54/102] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:56:13 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:56:14.402392 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-0c3d2a66-7ae9-40fa-a328-29bc379160ad tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:14.403032 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-0c3d2a66-7ae9-40fa-a328-29bc379160ad tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:14.409097 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0c3d2a66-7ae9-40fa-a328-29bc379160ad tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:14.409583 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0c3d2a66-7ae9-40fa-a328-29bc379160ad tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:14.410017 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0c3d2a66-7ae9-40fa-a328-29bc379160ad tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:14.410712 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0c3d2a66-7ae9-40fa-a328-29bc379160ad tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:14.411166 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0c3d2a66-7ae9-40fa-a328-29bc379160ad tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:14.411593 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0c3d2a66-7ae9-40fa-a328-29bc379160ad tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:14.559337 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-0c3d2a66-7ae9-40fa-a328-29bc379160ad tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:14.567222 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-0c3d2a66-7ae9-40fa-a328-29bc379160ad tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1322 microversion: 2.1 time: 0.168455 Aug 24 07:56:14.567691 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 49/103] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:14 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:14.595402 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-a9fdf11f-e246-499d-a7eb-7046ce036a9a tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:14.596048 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-a9fdf11f-e246-499d-a7eb-7046ce036a9a tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:14.602351 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a9fdf11f-e246-499d-a7eb-7046ce036a9a tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:14.602834 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a9fdf11f-e246-499d-a7eb-7046ce036a9a tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:14.603266 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a9fdf11f-e246-499d-a7eb-7046ce036a9a tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:14.603981 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a9fdf11f-e246-499d-a7eb-7046ce036a9a tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:14.604541 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a9fdf11f-e246-499d-a7eb-7046ce036a9a tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:14.604985 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a9fdf11f-e246-499d-a7eb-7046ce036a9a tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:14.752954 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a9fdf11f-e246-499d-a7eb-7046ce036a9a tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:14.759948 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-a9fdf11f-e246-499d-a7eb-7046ce036a9a tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1501 microversion: 2.1 time: 0.168434 Aug 24 07:56:14.760525 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 55/104] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:14 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1501 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:14.797225 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-e4a3c907-a1f5-4afa-a3c1-c547f8b42e1e req-627440bf-b266-4b45-ab04-2da28978e83d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f68297f-844b-4ab5-a37a-6bccb85cb78a", "name": "network-vif-plugged", "status": "completed", "tag": "49b68683-54d3-4b18-ac8e-682c0ebad5ee"}, {"server_uuid": "fb0fc412-e048-4edd-9a89-5aaaebb38a42", "name": "network-vif-plugged", "status": "completed", "tag": "5a81c1e6-d657-4fb4-a660-b452ce1735b0"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:56:14.809654 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-e4a3c907-a1f5-4afa-a3c1-c547f8b42e1e req-627440bf-b266-4b45-ab04-2da28978e83d service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:14.810127 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-e4a3c907-a1f5-4afa-a3c1-c547f8b42e1e req-627440bf-b266-4b45-ab04-2da28978e83d service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:14.810754 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-e4a3c907-a1f5-4afa-a3c1-c547f8b42e1e req-627440bf-b266-4b45-ab04-2da28978e83d service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:14.825309 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-e4a3c907-a1f5-4afa-a3c1-c547f8b42e1e req-627440bf-b266-4b45-ab04-2da28978e83d service nova] Creating event network-vif-plugged:49b68683-54d3-4b18-ac8e-682c0ebad5ee for instance 8f68297f-844b-4ab5-a37a-6bccb85cb78a on hv-cinder-85427 Aug 24 07:56:14.825924 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-e4a3c907-a1f5-4afa-a3c1-c547f8b42e1e req-627440bf-b266-4b45-ab04-2da28978e83d service nova] Creating event network-vif-plugged:5a81c1e6-d657-4fb4-a660-b452ce1735b0 for instance fb0fc412-e048-4edd-9a89-5aaaebb38a42 on hv-cinder-85427 Aug 24 07:56:14.832814 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-e4a3c907-a1f5-4afa-a3c1-c547f8b42e1e req-627440bf-b266-4b45-ab04-2da28978e83d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040514 Aug 24 07:56:14.833416 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 50/105] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:56:14.894325 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e0bc9728-cc9f-4906-9361-2ce134e29d65 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:14.898328 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-e0bc9728-cc9f-4906-9361-2ce134e29d65 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:14.901270 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e0bc9728-cc9f-4906-9361-2ce134e29d65 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:14.901833 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e0bc9728-cc9f-4906-9361-2ce134e29d65 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:14.902393 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e0bc9728-cc9f-4906-9361-2ce134e29d65 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:14.903192 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e0bc9728-cc9f-4906-9361-2ce134e29d65 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:14.903745 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e0bc9728-cc9f-4906-9361-2ce134e29d65 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:14.904271 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e0bc9728-cc9f-4906-9361-2ce134e29d65 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:15.062653 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e0bc9728-cc9f-4906-9361-2ce134e29d65 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:15.071224 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e0bc9728-cc9f-4906-9361-2ce134e29d65 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:15.073143 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e0bc9728-cc9f-4906-9361-2ce134e29d65 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:15.074359 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-e0bc9728-cc9f-4906-9361-2ce134e29d65 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1407 microversion: 2.20 time: 0.184056 Aug 24 07:56:15.076135 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 56/106] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:56:14 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:56:15.590165 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-475d09c0-b944-4532-966a-7ee0ecb31cab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:15.596436 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-475d09c0-b944-4532-966a-7ee0ecb31cab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:15.608016 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-475d09c0-b944-4532-966a-7ee0ecb31cab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:15.608512 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-475d09c0-b944-4532-966a-7ee0ecb31cab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:15.613724 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-475d09c0-b944-4532-966a-7ee0ecb31cab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:15.614562 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-475d09c0-b944-4532-966a-7ee0ecb31cab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:15.615046 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-475d09c0-b944-4532-966a-7ee0ecb31cab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:15.615467 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-475d09c0-b944-4532-966a-7ee0ecb31cab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:15.781956 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-475d09c0-b944-4532-966a-7ee0ecb31cab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:15.799588 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-475d09c0-b944-4532-966a-7ee0ecb31cab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1322 microversion: 2.1 time: 0.215652 Aug 24 07:56:15.800389 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 51/107] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:15 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:16.098962 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-22361b7e-da53-44d5-871a-de9fc6cb89a6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:16.099811 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-22361b7e-da53-44d5-871a-de9fc6cb89a6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:16.111901 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-22361b7e-da53-44d5-871a-de9fc6cb89a6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:16.111901 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-22361b7e-da53-44d5-871a-de9fc6cb89a6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:16.111901 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-22361b7e-da53-44d5-871a-de9fc6cb89a6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:16.111901 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-22361b7e-da53-44d5-871a-de9fc6cb89a6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:16.112247 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-22361b7e-da53-44d5-871a-de9fc6cb89a6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:16.112247 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-22361b7e-da53-44d5-871a-de9fc6cb89a6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:16.257015 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-22361b7e-da53-44d5-871a-de9fc6cb89a6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:16.262506 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=100 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:16.269190 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-22361b7e-da53-44d5-871a-de9fc6cb89a6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:16.270778 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-22361b7e-da53-44d5-871a-de9fc6cb89a6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:16.271820 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-22361b7e-da53-44d5-871a-de9fc6cb89a6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1407 microversion: 2.20 time: 0.178230 Aug 24 07:56:16.275488 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 57/108] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:56:16 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:56:16.824681 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-ce7c22bc-c8d3-4171-a6d8-4a4a74412998 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:16.825776 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-ce7c22bc-c8d3-4171-a6d8-4a4a74412998 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:16.831543 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ce7c22bc-c8d3-4171-a6d8-4a4a74412998 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:16.832029 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ce7c22bc-c8d3-4171-a6d8-4a4a74412998 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:16.832468 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ce7c22bc-c8d3-4171-a6d8-4a4a74412998 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:16.833200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ce7c22bc-c8d3-4171-a6d8-4a4a74412998 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:16.833656 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ce7c22bc-c8d3-4171-a6d8-4a4a74412998 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:16.834080 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ce7c22bc-c8d3-4171-a6d8-4a4a74412998 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:16.839951 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=100 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:16.974530 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-ce7c22bc-c8d3-4171-a6d8-4a4a74412998 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:16.985106 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-ce7c22bc-c8d3-4171-a6d8-4a4a74412998 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1322 microversion: 2.1 time: 0.162589 Aug 24 07:56:16.985106 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 52/109] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:16 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:17.294761 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-d336a2d9-c12c-4f0f-a081-6a381dbf5cf8 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:17.295371 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-d336a2d9-c12c-4f0f-a081-6a381dbf5cf8 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:17.303882 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d336a2d9-c12c-4f0f-a081-6a381dbf5cf8 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:17.304406 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d336a2d9-c12c-4f0f-a081-6a381dbf5cf8 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:17.305009 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d336a2d9-c12c-4f0f-a081-6a381dbf5cf8 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:17.307150 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d336a2d9-c12c-4f0f-a081-6a381dbf5cf8 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:17.307150 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d336a2d9-c12c-4f0f-a081-6a381dbf5cf8 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:17.307150 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d336a2d9-c12c-4f0f-a081-6a381dbf5cf8 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:17.467812 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-d336a2d9-c12c-4f0f-a081-6a381dbf5cf8 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:17.476761 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-d336a2d9-c12c-4f0f-a081-6a381dbf5cf8 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:17.478896 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-d336a2d9-c12c-4f0f-a081-6a381dbf5cf8 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:17.480030 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-d336a2d9-c12c-4f0f-a081-6a381dbf5cf8 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1407 microversion: 2.20 time: 0.189463 Aug 24 07:56:17.481609 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 58/110] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:56:17 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:56:18.011539 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-894cea7f-c447-4316-b6ac-fab2a8228049 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:18.013400 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-894cea7f-c447-4316-b6ac-fab2a8228049 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:18.031444 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-894cea7f-c447-4316-b6ac-fab2a8228049 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:18.036693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-894cea7f-c447-4316-b6ac-fab2a8228049 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:18.036693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-894cea7f-c447-4316-b6ac-fab2a8228049 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:18.036693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-894cea7f-c447-4316-b6ac-fab2a8228049 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:18.036693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-894cea7f-c447-4316-b6ac-fab2a8228049 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:18.037428 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-894cea7f-c447-4316-b6ac-fab2a8228049 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:18.276812 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-894cea7f-c447-4316-b6ac-fab2a8228049 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:18.289456 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-894cea7f-c447-4316-b6ac-fab2a8228049 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1322 microversion: 2.1 time: 0.282583 Aug 24 07:56:18.293334 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 53/111] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:18 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:18.507393 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-89319947-4c3d-4cf5-b230-b4b7dd38cfe5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:18.508214 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-89319947-4c3d-4cf5-b230-b4b7dd38cfe5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:18.515653 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-89319947-4c3d-4cf5-b230-b4b7dd38cfe5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:18.516314 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-89319947-4c3d-4cf5-b230-b4b7dd38cfe5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:18.516664 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-89319947-4c3d-4cf5-b230-b4b7dd38cfe5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:18.517376 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-89319947-4c3d-4cf5-b230-b4b7dd38cfe5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:18.517831 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-89319947-4c3d-4cf5-b230-b4b7dd38cfe5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:18.518254 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-89319947-4c3d-4cf5-b230-b4b7dd38cfe5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:18.653053 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-89319947-4c3d-4cf5-b230-b4b7dd38cfe5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:18.661774 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-89319947-4c3d-4cf5-b230-b4b7dd38cfe5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:18.663543 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-89319947-4c3d-4cf5-b230-b4b7dd38cfe5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:18.664751 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-89319947-4c3d-4cf5-b230-b4b7dd38cfe5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1598 microversion: 2.20 time: 0.161223 Aug 24 07:56:18.665298 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 59/112] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:56:18 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:56:18.690322 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-a0e144ad-b9a4-4940-a216-f9d614c8e4f4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:18.690813 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-a0e144ad-b9a4-4940-a216-f9d614c8e4f4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:18.696741 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a0e144ad-b9a4-4940-a216-f9d614c8e4f4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:18.697718 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a0e144ad-b9a4-4940-a216-f9d614c8e4f4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:18.698176 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a0e144ad-b9a4-4940-a216-f9d614c8e4f4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:18.699030 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a0e144ad-b9a4-4940-a216-f9d614c8e4f4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:18.699673 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a0e144ad-b9a4-4940-a216-f9d614c8e4f4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:18.700088 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a0e144ad-b9a4-4940-a216-f9d614c8e4f4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:18.812933 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-a0e144ad-b9a4-4940-a216-f9d614c8e4f4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.126868 Aug 24 07:56:18.813680 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 54/113] 10.222.0.72 () {60 vars in 1316 bytes} [Wed Aug 24 07:56:18 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:56:19.033950 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-4461d31c-1691-4d33-b5b9-a1b897762092 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef5162ee-778d-49dc-b9fb-698a164392e5"}} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:56:19.037197 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-4461d31c-1691-4d33-b5b9-a1b897762092 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:19.053072 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4461d31c-1691-4d33-b5b9-a1b897762092 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:19.054091 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4461d31c-1691-4d33-b5b9-a1b897762092 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:19.054762 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4461d31c-1691-4d33-b5b9-a1b897762092 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:19.055716 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4461d31c-1691-4d33-b5b9-a1b897762092 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:19.056968 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4461d31c-1691-4d33-b5b9-a1b897762092 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:19.057704 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4461d31c-1691-4d33-b5b9-a1b897762092 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:19.311427 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-71b61b55-18a6-4c1e-bb85-afbe7fad0d1d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:19.312898 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-71b61b55-18a6-4c1e-bb85-afbe7fad0d1d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:19.319477 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-71b61b55-18a6-4c1e-bb85-afbe7fad0d1d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:19.320162 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-71b61b55-18a6-4c1e-bb85-afbe7fad0d1d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:19.320814 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-71b61b55-18a6-4c1e-bb85-afbe7fad0d1d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:19.321723 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-71b61b55-18a6-4c1e-bb85-afbe7fad0d1d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:19.322521 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-71b61b55-18a6-4c1e-bb85-afbe7fad0d1d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:19.323094 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-71b61b55-18a6-4c1e-bb85-afbe7fad0d1d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:19.583492 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-71b61b55-18a6-4c1e-bb85-afbe7fad0d1d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:19.593611 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-71b61b55-18a6-4c1e-bb85-afbe7fad0d1d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1322 microversion: 2.1 time: 0.285182 Aug 24 07:56:19.594440 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 55/114] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:19 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:20.478650 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-a4f8a890-da04-40fd-9ce5-5fb3fe37c43f req-d1bbebe6-dc29-48a5-b14f-0142bcddc95a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a266e179-03cc-40b3-902d-aab680174711", "tag": "45373581-1bd1-4a1b-aff0-a6e9993cd6b9"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:56:20.489127 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-a4f8a890-da04-40fd-9ce5-5fb3fe37c43f req-d1bbebe6-dc29-48a5-b14f-0142bcddc95a service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:20.489601 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-a4f8a890-da04-40fd-9ce5-5fb3fe37c43f req-d1bbebe6-dc29-48a5-b14f-0142bcddc95a service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:20.490191 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-a4f8a890-da04-40fd-9ce5-5fb3fe37c43f req-d1bbebe6-dc29-48a5-b14f-0142bcddc95a service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:20.511624 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-a4f8a890-da04-40fd-9ce5-5fb3fe37c43f req-d1bbebe6-dc29-48a5-b14f-0142bcddc95a service nova] Creating event network-changed:45373581-1bd1-4a1b-aff0-a6e9993cd6b9 for instance a266e179-03cc-40b3-902d-aab680174711 on hv-cinder-85427 Aug 24 07:56:20.520088 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-a4f8a890-da04-40fd-9ce5-5fb3fe37c43f req-d1bbebe6-dc29-48a5-b14f-0142bcddc95a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045802 Aug 24 07:56:20.521349 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 56/115] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:56:20.616071 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-ea7f4b7b-180b-4037-bbc7-03191a6342df tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:20.616908 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-ea7f4b7b-180b-4037-bbc7-03191a6342df tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:20.625599 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ea7f4b7b-180b-4037-bbc7-03191a6342df tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:20.625599 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ea7f4b7b-180b-4037-bbc7-03191a6342df tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:20.625599 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ea7f4b7b-180b-4037-bbc7-03191a6342df tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:20.626070 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ea7f4b7b-180b-4037-bbc7-03191a6342df tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:20.626642 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ea7f4b7b-180b-4037-bbc7-03191a6342df tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:20.627173 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ea7f4b7b-180b-4037-bbc7-03191a6342df tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:20.852314 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-ea7f4b7b-180b-4037-bbc7-03191a6342df tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:20.863622 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-ea7f4b7b-180b-4037-bbc7-03191a6342df tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1515 microversion: 2.1 time: 0.251657 Aug 24 07:56:20.865626 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 57/116] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:20 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1515 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:20.890203 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-ed0eba20-8bfe-4ad8-a9aa-549d4fde6e4b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:56:20.892699 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-ed0eba20-8bfe-4ad8-a9aa-549d4fde6e4b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:20.903481 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ed0eba20-8bfe-4ad8-a9aa-549d4fde6e4b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:20.910163 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ed0eba20-8bfe-4ad8-a9aa-549d4fde6e4b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:20.913320 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ed0eba20-8bfe-4ad8-a9aa-549d4fde6e4b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:20.914298 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ed0eba20-8bfe-4ad8-a9aa-549d4fde6e4b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:20.917010 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ed0eba20-8bfe-4ad8-a9aa-549d4fde6e4b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:20.917675 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ed0eba20-8bfe-4ad8-a9aa-549d4fde6e4b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:20.971200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.objects.instance [None req-ed0eba20-8bfe-4ad8-a9aa-549d4fde6e4b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lazy-loading 'flavor' on Instance uuid 8f68297f-844b-4ab5-a37a-6bccb85cb78a {{(pid=127590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:56:21.487929 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-ed0eba20-8bfe-4ad8-a9aa-549d4fde6e4b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "POST /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a/action" status: 200 len: 32 microversion: 2.1 time: 0.602009 Aug 24 07:56:21.488574 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 58/117] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 24 07:56:20 2022] POST /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a/action => generated 32 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 07:56:21.498715 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-2753062f-b040-4dbe-8803-c08c7face178 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:21.503437 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-2753062f-b040-4dbe-8803-c08c7face178 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:21.511258 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2753062f-b040-4dbe-8803-c08c7face178 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:21.512001 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2753062f-b040-4dbe-8803-c08c7face178 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:21.512950 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2753062f-b040-4dbe-8803-c08c7face178 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:21.515515 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2753062f-b040-4dbe-8803-c08c7face178 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:21.515759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2753062f-b040-4dbe-8803-c08c7face178 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:21.516555 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2753062f-b040-4dbe-8803-c08c7face178 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:21.706839 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-2753062f-b040-4dbe-8803-c08c7face178 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:21.717038 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-2753062f-b040-4dbe-8803-c08c7face178 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.222342 Aug 24 07:56:21.725589 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 59/118] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:21 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:21.885201 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-4461d31c-1691-4d33-b5b9-a1b897762092 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "POST /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.849628 Aug 24 07:56:21.885201 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 60/119] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 24 07:56:19 2022] POST /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b/os-volume_attachments => generated 194 bytes in 2853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:56:22.750367 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-383bbe55-bb43-4a54-b108-38b8465c8725 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:22.750893 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-383bbe55-bb43-4a54-b108-38b8465c8725 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:22.756947 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-383bbe55-bb43-4a54-b108-38b8465c8725 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:22.757430 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-383bbe55-bb43-4a54-b108-38b8465c8725 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:22.761480 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-383bbe55-bb43-4a54-b108-38b8465c8725 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:22.761480 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-383bbe55-bb43-4a54-b108-38b8465c8725 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:22.761480 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-383bbe55-bb43-4a54-b108-38b8465c8725 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:22.761480 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-383bbe55-bb43-4a54-b108-38b8465c8725 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:22.893824 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-383bbe55-bb43-4a54-b108-38b8465c8725 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:22.904516 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-383bbe55-bb43-4a54-b108-38b8465c8725 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.156002 Aug 24 07:56:22.904516 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 60/120] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:22 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:23.925924 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-3515036a-2058-4947-82ab-3845cc53689a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:23.926625 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-3515036a-2058-4947-82ab-3845cc53689a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:23.933355 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3515036a-2058-4947-82ab-3845cc53689a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:23.933817 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3515036a-2058-4947-82ab-3845cc53689a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:23.934253 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3515036a-2058-4947-82ab-3845cc53689a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:23.934939 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3515036a-2058-4947-82ab-3845cc53689a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:23.935391 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3515036a-2058-4947-82ab-3845cc53689a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:23.935812 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3515036a-2058-4947-82ab-3845cc53689a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:24.075574 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-3515036a-2058-4947-82ab-3845cc53689a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:24.086275 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-3515036a-2058-4947-82ab-3845cc53689a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.165122 Aug 24 07:56:24.086932 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 61/121] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:23 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:25.107031 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-a3a14e9e-8503-42b0-877f-06030f9e90e9 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:25.107654 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-a3a14e9e-8503-42b0-877f-06030f9e90e9 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:25.113816 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a3a14e9e-8503-42b0-877f-06030f9e90e9 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:25.114359 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a3a14e9e-8503-42b0-877f-06030f9e90e9 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:25.114803 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a3a14e9e-8503-42b0-877f-06030f9e90e9 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:25.115505 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a3a14e9e-8503-42b0-877f-06030f9e90e9 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:25.115958 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a3a14e9e-8503-42b0-877f-06030f9e90e9 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:25.116379 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a3a14e9e-8503-42b0-877f-06030f9e90e9 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:25.255290 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-a3a14e9e-8503-42b0-877f-06030f9e90e9 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:25.263212 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-a3a14e9e-8503-42b0-877f-06030f9e90e9 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.160628 Aug 24 07:56:25.263787 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 61/122] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:25 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:26.284413 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-fc2d929c-a05d-4a62-899b-ff1f68c79374 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:26.285061 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-fc2d929c-a05d-4a62-899b-ff1f68c79374 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:26.297436 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fc2d929c-a05d-4a62-899b-ff1f68c79374 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:26.299695 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fc2d929c-a05d-4a62-899b-ff1f68c79374 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:26.300193 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fc2d929c-a05d-4a62-899b-ff1f68c79374 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:26.302207 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fc2d929c-a05d-4a62-899b-ff1f68c79374 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:26.302692 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fc2d929c-a05d-4a62-899b-ff1f68c79374 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:26.303181 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fc2d929c-a05d-4a62-899b-ff1f68c79374 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:26.559910 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-fc2d929c-a05d-4a62-899b-ff1f68c79374 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:26.569815 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-fc2d929c-a05d-4a62-899b-ff1f68c79374 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.290251 Aug 24 07:56:26.570397 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 62/123] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:26 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:27.596713 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-aa7277a7-ac96-4219-830d-9b1f128dbd69 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:27.596713 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-aa7277a7-ac96-4219-830d-9b1f128dbd69 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:27.601730 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-aa7277a7-ac96-4219-830d-9b1f128dbd69 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:27.602577 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-aa7277a7-ac96-4219-830d-9b1f128dbd69 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:27.603210 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-aa7277a7-ac96-4219-830d-9b1f128dbd69 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:27.604263 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-aa7277a7-ac96-4219-830d-9b1f128dbd69 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:27.605023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-aa7277a7-ac96-4219-830d-9b1f128dbd69 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:27.605810 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-aa7277a7-ac96-4219-830d-9b1f128dbd69 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:27.803274 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-aa7277a7-ac96-4219-830d-9b1f128dbd69 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:27.813458 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-aa7277a7-ac96-4219-830d-9b1f128dbd69 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.225138 Aug 24 07:56:27.814079 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 62/124] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:27 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:28.834639 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-3e1761e3-a04c-4094-bc3c-1486b8921199 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:28.835864 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-3e1761e3-a04c-4094-bc3c-1486b8921199 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:28.843059 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3e1761e3-a04c-4094-bc3c-1486b8921199 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:28.843699 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3e1761e3-a04c-4094-bc3c-1486b8921199 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:28.844351 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3e1761e3-a04c-4094-bc3c-1486b8921199 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:28.858074 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3e1761e3-a04c-4094-bc3c-1486b8921199 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:28.864950 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3e1761e3-a04c-4094-bc3c-1486b8921199 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:28.865510 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3e1761e3-a04c-4094-bc3c-1486b8921199 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:29.022904 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-3e1761e3-a04c-4094-bc3c-1486b8921199 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:29.031273 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-3e1761e3-a04c-4094-bc3c-1486b8921199 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.200923 Aug 24 07:56:29.031846 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 63/125] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:28 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:30.053237 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-237a483a-dd29-498c-b56b-b46b76fc819f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:30.053914 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-237a483a-dd29-498c-b56b-b46b76fc819f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:30.059994 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-237a483a-dd29-498c-b56b-b46b76fc819f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:30.060801 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-237a483a-dd29-498c-b56b-b46b76fc819f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:30.061923 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-237a483a-dd29-498c-b56b-b46b76fc819f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:30.063436 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-237a483a-dd29-498c-b56b-b46b76fc819f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:30.064127 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-237a483a-dd29-498c-b56b-b46b76fc819f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:30.064711 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-237a483a-dd29-498c-b56b-b46b76fc819f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:30.235983 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-237a483a-dd29-498c-b56b-b46b76fc819f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:30.245011 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-237a483a-dd29-498c-b56b-b46b76fc819f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.195397 Aug 24 07:56:30.245554 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 63/126] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:30 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:31.266584 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-a789bf64-be7d-4ec3-8a73-4d074c60fd07 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:31.268053 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-a789bf64-be7d-4ec3-8a73-4d074c60fd07 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:31.275240 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a789bf64-be7d-4ec3-8a73-4d074c60fd07 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:31.276018 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a789bf64-be7d-4ec3-8a73-4d074c60fd07 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:31.276723 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a789bf64-be7d-4ec3-8a73-4d074c60fd07 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:31.277722 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a789bf64-be7d-4ec3-8a73-4d074c60fd07 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:31.278283 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a789bf64-be7d-4ec3-8a73-4d074c60fd07 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:31.278943 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a789bf64-be7d-4ec3-8a73-4d074c60fd07 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:31.447038 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a789bf64-be7d-4ec3-8a73-4d074c60fd07 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:31.455124 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-a789bf64-be7d-4ec3-8a73-4d074c60fd07 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.192575 Aug 24 07:56:31.455699 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 64/127] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:31 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:32.477161 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-5a1ce6e1-7278-4eea-aaef-5317c2f14ff7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:32.477812 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-5a1ce6e1-7278-4eea-aaef-5317c2f14ff7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:32.483618 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5a1ce6e1-7278-4eea-aaef-5317c2f14ff7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:32.484105 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5a1ce6e1-7278-4eea-aaef-5317c2f14ff7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:32.484546 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5a1ce6e1-7278-4eea-aaef-5317c2f14ff7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:32.485265 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5a1ce6e1-7278-4eea-aaef-5317c2f14ff7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:32.488637 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5a1ce6e1-7278-4eea-aaef-5317c2f14ff7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:32.489286 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5a1ce6e1-7278-4eea-aaef-5317c2f14ff7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:32.704615 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-5a1ce6e1-7278-4eea-aaef-5317c2f14ff7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:32.718202 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-5a1ce6e1-7278-4eea-aaef-5317c2f14ff7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.240324 Aug 24 07:56:32.718202 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 64/128] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:32 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:33.734298 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-dcf36e26-3c29-4290-a162-e0ec54779321 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:33.734916 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-dcf36e26-3c29-4290-a162-e0ec54779321 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:33.741271 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-dcf36e26-3c29-4290-a162-e0ec54779321 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:33.741814 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-dcf36e26-3c29-4290-a162-e0ec54779321 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:33.742251 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-dcf36e26-3c29-4290-a162-e0ec54779321 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:33.743570 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-dcf36e26-3c29-4290-a162-e0ec54779321 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:33.744014 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-dcf36e26-3c29-4290-a162-e0ec54779321 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:33.744439 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-dcf36e26-3c29-4290-a162-e0ec54779321 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:33.752118 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-7d4bdeee-a991-41bc-8c64-40fb1a765c83 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:33.755400 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-7d4bdeee-a991-41bc-8c64-40fb1a765c83 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:33.763892 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d4bdeee-a991-41bc-8c64-40fb1a765c83 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:33.764390 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d4bdeee-a991-41bc-8c64-40fb1a765c83 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:33.764869 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d4bdeee-a991-41bc-8c64-40fb1a765c83 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:33.771082 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d4bdeee-a991-41bc-8c64-40fb1a765c83 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:33.771566 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d4bdeee-a991-41bc-8c64-40fb1a765c83 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:33.772005 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d4bdeee-a991-41bc-8c64-40fb1a765c83 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:33.801276 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-7d4bdeee-a991-41bc-8c64-40fb1a765c83 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Going to try to terminate instance {{(pid=127590) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:56:34.097105 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-dcf36e26-3c29-4290-a162-e0ec54779321 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:34.110857 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-dcf36e26-3c29-4290-a162-e0ec54779321 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.379815 Aug 24 07:56:34.113583 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 65/129] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:33 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:34.201905 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-7d4bdeee-a991-41bc-8c64-40fb1a765c83 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "DELETE /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 204 len: 0 microversion: 2.1 time: 0.450879 Aug 24 07:56:34.202618 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 65/130] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 24 07:56:33 2022] DELETE /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 07:56:34.212052 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-64a8b421-3971-4737-a2d3-0e5355f1d908 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:34.212703 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-64a8b421-3971-4737-a2d3-0e5355f1d908 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:34.218893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-64a8b421-3971-4737-a2d3-0e5355f1d908 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:34.219379 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-64a8b421-3971-4737-a2d3-0e5355f1d908 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:34.219815 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-64a8b421-3971-4737-a2d3-0e5355f1d908 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:34.220573 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-64a8b421-3971-4737-a2d3-0e5355f1d908 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:34.221051 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-64a8b421-3971-4737-a2d3-0e5355f1d908 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:34.221476 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-64a8b421-3971-4737-a2d3-0e5355f1d908 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:34.363402 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-64a8b421-3971-4737-a2d3-0e5355f1d908 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:34.372378 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-64a8b421-3971-4737-a2d3-0e5355f1d908 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1553 microversion: 2.1 time: 0.164232 Aug 24 07:56:34.373030 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 66/131] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:34 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:35.141938 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-d7314c9d-4735-49b6-b1c8-a94025a12ff7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:35.142613 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-d7314c9d-4735-49b6-b1c8-a94025a12ff7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:35.159372 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d7314c9d-4735-49b6-b1c8-a94025a12ff7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:35.159881 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d7314c9d-4735-49b6-b1c8-a94025a12ff7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:35.160319 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d7314c9d-4735-49b6-b1c8-a94025a12ff7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:35.161078 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d7314c9d-4735-49b6-b1c8-a94025a12ff7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:35.161799 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d7314c9d-4735-49b6-b1c8-a94025a12ff7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:35.162224 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d7314c9d-4735-49b6-b1c8-a94025a12ff7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:35.166967 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:35.390755 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-d7314c9d-4735-49b6-b1c8-a94025a12ff7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:35.394122 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-03640795-7ba3-455e-ac2d-34e654318d8e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:35.395816 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-03640795-7ba3-455e-ac2d-34e654318d8e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:35.404076 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-03640795-7ba3-455e-ac2d-34e654318d8e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:35.408019 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-03640795-7ba3-455e-ac2d-34e654318d8e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:35.408877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-03640795-7ba3-455e-ac2d-34e654318d8e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:35.409451 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-d7314c9d-4735-49b6-b1c8-a94025a12ff7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.276771 Aug 24 07:56:35.410345 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 66/132] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:35 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:35.419387 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-03640795-7ba3-455e-ac2d-34e654318d8e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:35.421430 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-03640795-7ba3-455e-ac2d-34e654318d8e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:35.422513 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-03640795-7ba3-455e-ac2d-34e654318d8e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:35.601981 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-03640795-7ba3-455e-ac2d-34e654318d8e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:35.612123 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-03640795-7ba3-455e-ac2d-34e654318d8e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1553 microversion: 2.1 time: 0.222234 Aug 24 07:56:35.615834 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 67/133] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:35 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1553 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:36.432071 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-af52d06b-a0b6-4daa-bf0b-5ff8d8348d7e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:36.433332 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-af52d06b-a0b6-4daa-bf0b-5ff8d8348d7e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:36.435413 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:36.443207 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-af52d06b-a0b6-4daa-bf0b-5ff8d8348d7e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:36.444414 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-af52d06b-a0b6-4daa-bf0b-5ff8d8348d7e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:36.445352 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-af52d06b-a0b6-4daa-bf0b-5ff8d8348d7e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:36.447038 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-af52d06b-a0b6-4daa-bf0b-5ff8d8348d7e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:36.448101 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-af52d06b-a0b6-4daa-bf0b-5ff8d8348d7e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:36.448969 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-af52d06b-a0b6-4daa-bf0b-5ff8d8348d7e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:36.607811 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-af52d06b-a0b6-4daa-bf0b-5ff8d8348d7e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:36.618570 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-af52d06b-a0b6-4daa-bf0b-5ff8d8348d7e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.191075 Aug 24 07:56:36.628616 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 67/134] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:36 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:36.639185 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-2d71db67-7737-4beb-a08b-c1822a128505 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:36.639800 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-2d71db67-7737-4beb-a08b-c1822a128505 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:36.646741 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2d71db67-7737-4beb-a08b-c1822a128505 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:36.647419 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2d71db67-7737-4beb-a08b-c1822a128505 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:36.647859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2d71db67-7737-4beb-a08b-c1822a128505 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:36.648563 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2d71db67-7737-4beb-a08b-c1822a128505 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:36.649748 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2d71db67-7737-4beb-a08b-c1822a128505 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:36.650338 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2d71db67-7737-4beb-a08b-c1822a128505 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:36.817385 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-2d71db67-7737-4beb-a08b-c1822a128505 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:36.826795 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-2d71db67-7737-4beb-a08b-c1822a128505 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1553 microversion: 2.1 time: 0.193163 Aug 24 07:56:36.827723 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 68/135] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:36 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1553 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:37.640303 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-9e6514f8-894c-4bd3-8181-4d3cd7cde171 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:37.640990 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-9e6514f8-894c-4bd3-8181-4d3cd7cde171 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:37.647979 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e6514f8-894c-4bd3-8181-4d3cd7cde171 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:37.648542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e6514f8-894c-4bd3-8181-4d3cd7cde171 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:37.649077 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e6514f8-894c-4bd3-8181-4d3cd7cde171 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:37.649842 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e6514f8-894c-4bd3-8181-4d3cd7cde171 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:37.650459 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e6514f8-894c-4bd3-8181-4d3cd7cde171 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:37.650884 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e6514f8-894c-4bd3-8181-4d3cd7cde171 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:37.788863 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9e6514f8-894c-4bd3-8181-4d3cd7cde171 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:37.796953 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-9e6514f8-894c-4bd3-8181-4d3cd7cde171 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.161321 Aug 24 07:56:37.804251 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 68/136] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:37 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:37.849317 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-7bd3fd57-6d19-4df8-adac-745f06b7d585 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:37.849836 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-7bd3fd57-6d19-4df8-adac-745f06b7d585 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:37.856290 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7bd3fd57-6d19-4df8-adac-745f06b7d585 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:37.856810 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7bd3fd57-6d19-4df8-adac-745f06b7d585 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:37.857249 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7bd3fd57-6d19-4df8-adac-745f06b7d585 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:37.857935 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7bd3fd57-6d19-4df8-adac-745f06b7d585 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:37.858389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7bd3fd57-6d19-4df8-adac-745f06b7d585 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:37.858811 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7bd3fd57-6d19-4df8-adac-745f06b7d585 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:37.987505 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7bd3fd57-6d19-4df8-adac-745f06b7d585 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:37.996668 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-7bd3fd57-6d19-4df8-adac-745f06b7d585 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1553 microversion: 2.1 time: 0.151271 Aug 24 07:56:37.997234 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 69/137] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:37 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:38.818859 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-df89e518-0e28-4b6e-aca1-c2a78a100531 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:38.819459 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-df89e518-0e28-4b6e-aca1-c2a78a100531 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:38.825702 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-df89e518-0e28-4b6e-aca1-c2a78a100531 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:38.826175 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-df89e518-0e28-4b6e-aca1-c2a78a100531 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:38.826604 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-df89e518-0e28-4b6e-aca1-c2a78a100531 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:38.827939 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-df89e518-0e28-4b6e-aca1-c2a78a100531 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:38.827939 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-df89e518-0e28-4b6e-aca1-c2a78a100531 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:38.828185 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-df89e518-0e28-4b6e-aca1-c2a78a100531 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:38.959635 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-df89e518-0e28-4b6e-aca1-c2a78a100531 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:38.967181 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-df89e518-0e28-4b6e-aca1-c2a78a100531 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.152860 Aug 24 07:56:38.969752 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 69/138] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:38 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:39.017327 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-2a461842-ea7f-4f26-ab7c-3a7851c20566 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:39.018151 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-2a461842-ea7f-4f26-ab7c-3a7851c20566 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:39.020917 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=52 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:39.026430 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2a461842-ea7f-4f26-ab7c-3a7851c20566 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:39.027168 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2a461842-ea7f-4f26-ab7c-3a7851c20566 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:39.027395 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2a461842-ea7f-4f26-ab7c-3a7851c20566 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:39.028094 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2a461842-ea7f-4f26-ab7c-3a7851c20566 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:39.028551 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2a461842-ea7f-4f26-ab7c-3a7851c20566 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:39.029041 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2a461842-ea7f-4f26-ab7c-3a7851c20566 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:39.169784 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-2a461842-ea7f-4f26-ab7c-3a7851c20566 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:39.178448 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-2a461842-ea7f-4f26-ab7c-3a7851c20566 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1553 microversion: 2.1 time: 0.165013 Aug 24 07:56:39.181925 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 70/139] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:39 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:39.509315 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-4fa6890c-604f-4481-bd19-27b2cc8576db tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-447613058", "imageRef": "ccdab334-55ce-4ff5-bd97-5a424660c282", "flavorRef": "452", "networks": [{"uuid": "3a6228c9-5ae1-4d34-9726-5ba5af8c41d6"}]}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:56:39.564751 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.network.neutron [None req-4fa6890c-604f-4481-bd19-27b2cc8576db tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] validate_networks() for [('3a6228c9-5ae1-4d34-9726-5ba5af8c41d6', None, None, None, None, None)] {{(pid=127590) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:56:39.935298 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-4fa6890c-604f-4481-bd19-27b2cc8576db tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Flavor limits 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:56:39.935298 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-4fa6890c-604f-4481-bd19-27b2cc8576db tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Image limits 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:56:39.935298 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-4fa6890c-604f-4481-bd19-27b2cc8576db tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Flavor pref 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:56:39.935298 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-4fa6890c-604f-4481-bd19-27b2cc8576db tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Image pref 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:56:39.935298 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-4fa6890c-604f-4481-bd19-27b2cc8576db tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:56:39.936135 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4fa6890c-604f-4481-bd19-27b2cc8576db tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:39.936471 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4fa6890c-604f-4481-bd19-27b2cc8576db tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:39.936938 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4fa6890c-604f-4481-bd19-27b2cc8576db tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:39.937647 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4fa6890c-604f-4481-bd19-27b2cc8576db tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:39.938111 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4fa6890c-604f-4481-bd19-27b2cc8576db tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:39.938692 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4fa6890c-604f-4481-bd19-27b2cc8576db tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:39.956379 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-4fa6890c-604f-4481-bd19-27b2cc8576db tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Getting quotas for project 647a6443ec0c49e58d3cdb373d681c38. Resources: {'cores', 'instances', 'ram'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:56:39.960773 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-4fa6890c-604f-4481-bd19-27b2cc8576db tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Getting quotas for user ed5bde75f6d2477ab2747016ab5c309e and project 647a6443ec0c49e58d3cdb373d681c38. Resources: {'cores', 'instances', 'ram'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:56:39.972788 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-4fa6890c-604f-4481-bd19-27b2cc8576db tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Going to run 1 instances... {{(pid=127590) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:56:39.975040 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-4fa6890c-604f-4481-bd19-27b2cc8576db tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccdab334-55ce-4ff5-bd97-5a424660c282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:56:39.988494 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-804b3bc3-27b6-4545-8527-6111f9441b08 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:39.989171 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-804b3bc3-27b6-4545-8527-6111f9441b08 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:39.995443 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-804b3bc3-27b6-4545-8527-6111f9441b08 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:39.995942 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-804b3bc3-27b6-4545-8527-6111f9441b08 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:39.996369 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-804b3bc3-27b6-4545-8527-6111f9441b08 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:39.997078 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-804b3bc3-27b6-4545-8527-6111f9441b08 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:39.997525 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-804b3bc3-27b6-4545-8527-6111f9441b08 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:39.997945 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-804b3bc3-27b6-4545-8527-6111f9441b08 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:40.127855 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-4fa6890c-604f-4481-bd19-27b2cc8576db tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.622524 Aug 24 07:56:40.128684 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 70/140] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 24 07:56:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:56:40.138304 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-804b3bc3-27b6-4545-8527-6111f9441b08 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:40.139704 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-2d5ca1c8-9362-4bb3-bf45-b38583229a59 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:40.140514 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-2d5ca1c8-9362-4bb3-bf45-b38583229a59 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:40.146638 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-804b3bc3-27b6-4545-8527-6111f9441b08 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.161937 Aug 24 07:56:40.147415 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 71/141] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:39 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:40.200197 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-49a3cf18-78a7-462c-9efb-6e0f568d7b4c tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:40.200866 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-49a3cf18-78a7-462c-9efb-6e0f568d7b4c tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:40.202648 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-2d5ca1c8-9362-4bb3-bf45-b38583229a59 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:40.210720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-2d5ca1c8-9362-4bb3-bf45-b38583229a59 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 200 len: 1213 microversion: 2.1 time: 0.074945 Aug 24 07:56:40.211291 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 71/142] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:40 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 1213 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:40.212932 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-49a3cf18-78a7-462c-9efb-6e0f568d7b4c tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:40.214009 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-49a3cf18-78a7-462c-9efb-6e0f568d7b4c tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:40.214868 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-49a3cf18-78a7-462c-9efb-6e0f568d7b4c tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:40.215602 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-49a3cf18-78a7-462c-9efb-6e0f568d7b4c tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:40.216125 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-49a3cf18-78a7-462c-9efb-6e0f568d7b4c tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:40.216832 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-49a3cf18-78a7-462c-9efb-6e0f568d7b4c tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:40.381076 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-49a3cf18-78a7-462c-9efb-6e0f568d7b4c tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:40.390109 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-49a3cf18-78a7-462c-9efb-6e0f568d7b4c tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1553 microversion: 2.1 time: 0.194634 Aug 24 07:56:40.390689 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 72/143] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:40 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1553 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:40.448772 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-1a15b7cd-79ad-46cb-9f15-588607d1f4bb req-7f84311d-2680-4f00-ac9b-ba628e91c55a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da017fd6-2861-4ef8-b216-cb16309cdf1b", "name": "network-vif-unplugged", "status": "completed", "tag": "cddb0d7e-7022-4a60-ba3b-4112336a886c"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:56:40.458781 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-1a15b7cd-79ad-46cb-9f15-588607d1f4bb req-7f84311d-2680-4f00-ac9b-ba628e91c55a service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:40.459259 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-1a15b7cd-79ad-46cb-9f15-588607d1f4bb req-7f84311d-2680-4f00-ac9b-ba628e91c55a service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:40.459683 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-1a15b7cd-79ad-46cb-9f15-588607d1f4bb req-7f84311d-2680-4f00-ac9b-ba628e91c55a service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:40.471731 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-1a15b7cd-79ad-46cb-9f15-588607d1f4bb req-7f84311d-2680-4f00-ac9b-ba628e91c55a service nova] Creating event network-vif-unplugged:cddb0d7e-7022-4a60-ba3b-4112336a886c for instance da017fd6-2861-4ef8-b216-cb16309cdf1b on hv-cinder-85427 Aug 24 07:56:40.477189 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-1a15b7cd-79ad-46cb-9f15-588607d1f4bb req-7f84311d-2680-4f00-ac9b-ba628e91c55a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032684 Aug 24 07:56:40.477836 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 72/144] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:56:41.168041 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-cc1f6a6e-fdb5-4606-ab34-bc9fdb5238cb tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:41.168643 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-cc1f6a6e-fdb5-4606-ab34-bc9fdb5238cb tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:41.174963 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc1f6a6e-fdb5-4606-ab34-bc9fdb5238cb tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:41.175424 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc1f6a6e-fdb5-4606-ab34-bc9fdb5238cb tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:41.175850 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc1f6a6e-fdb5-4606-ab34-bc9fdb5238cb tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:41.176529 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc1f6a6e-fdb5-4606-ab34-bc9fdb5238cb tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:41.177005 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc1f6a6e-fdb5-4606-ab34-bc9fdb5238cb tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:41.177419 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc1f6a6e-fdb5-4606-ab34-bc9fdb5238cb tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:41.181369 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:41.233633 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-11e99d8c-aea4-4f30-990f-4f84ec9e93b3 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:41.234323 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-11e99d8c-aea4-4f30-990f-4f84ec9e93b3 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:41.240624 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-11e99d8c-aea4-4f30-990f-4f84ec9e93b3 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:41.241134 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-11e99d8c-aea4-4f30-990f-4f84ec9e93b3 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:41.241566 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-11e99d8c-aea4-4f30-990f-4f84ec9e93b3 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:41.242261 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-11e99d8c-aea4-4f30-990f-4f84ec9e93b3 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:41.242706 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-11e99d8c-aea4-4f30-990f-4f84ec9e93b3 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:41.243137 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-11e99d8c-aea4-4f30-990f-4f84ec9e93b3 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:41.305325 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-11e99d8c-aea4-4f30-990f-4f84ec9e93b3 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:41.311182 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-cc1f6a6e-fdb5-4606-ab34-bc9fdb5238cb tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:41.314401 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-11e99d8c-aea4-4f30-990f-4f84ec9e93b3 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 200 len: 1217 microversion: 2.1 time: 0.085554 Aug 24 07:56:41.314975 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 73/145] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:41 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:41.320976 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-cc1f6a6e-fdb5-4606-ab34-bc9fdb5238cb tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.157223 Aug 24 07:56:41.321631 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 73/146] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:41 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:41.411469 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-daebbcd8-908f-4dad-bc4e-fe0c8ecd433e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:41.412073 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-daebbcd8-908f-4dad-bc4e-fe0c8ecd433e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:41.418986 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-daebbcd8-908f-4dad-bc4e-fe0c8ecd433e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:41.419460 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-daebbcd8-908f-4dad-bc4e-fe0c8ecd433e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:41.419888 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-daebbcd8-908f-4dad-bc4e-fe0c8ecd433e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:41.420562 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-daebbcd8-908f-4dad-bc4e-fe0c8ecd433e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:41.421036 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-daebbcd8-908f-4dad-bc4e-fe0c8ecd433e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:41.421450 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-daebbcd8-908f-4dad-bc4e-fe0c8ecd433e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:41.553111 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-daebbcd8-908f-4dad-bc4e-fe0c8ecd433e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:41.561248 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-daebbcd8-908f-4dad-bc4e-fe0c8ecd433e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1553 microversion: 2.1 time: 0.153840 Aug 24 07:56:41.561811 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 74/147] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:41 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:42.335063 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-6ea38576-0306-4136-8958-5c8a4112cc71 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:42.335624 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-6ea38576-0306-4136-8958-5c8a4112cc71 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:42.342329 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-08e15c58-2c79-49e5-a42f-2f0594bf09cb tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:42.347221 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-08e15c58-2c79-49e5-a42f-2f0594bf09cb tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:42.350556 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-08e15c58-2c79-49e5-a42f-2f0594bf09cb tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:42.355737 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6ea38576-0306-4136-8958-5c8a4112cc71 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:42.356254 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6ea38576-0306-4136-8958-5c8a4112cc71 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:42.356679 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6ea38576-0306-4136-8958-5c8a4112cc71 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:42.357371 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6ea38576-0306-4136-8958-5c8a4112cc71 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:42.357823 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6ea38576-0306-4136-8958-5c8a4112cc71 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:42.358267 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6ea38576-0306-4136-8958-5c8a4112cc71 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:42.362902 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-08e15c58-2c79-49e5-a42f-2f0594bf09cb tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:42.363610 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-08e15c58-2c79-49e5-a42f-2f0594bf09cb tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:42.364362 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-08e15c58-2c79-49e5-a42f-2f0594bf09cb tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:42.364983 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-08e15c58-2c79-49e5-a42f-2f0594bf09cb tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:42.366325 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-08e15c58-2c79-49e5-a42f-2f0594bf09cb tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:42.477175 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-6ea38576-0306-4136-8958-5c8a4112cc71 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:42.486579 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-6ea38576-0306-4136-8958-5c8a4112cc71 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 200 len: 1217 microversion: 2.1 time: 0.155421 Aug 24 07:56:42.487174 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 74/148] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:42 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:42.537125 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-08e15c58-2c79-49e5-a42f-2f0594bf09cb tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:42.547339 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-08e15c58-2c79-49e5-a42f-2f0594bf09cb tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.208767 Aug 24 07:56:42.565339 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 75/149] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:42 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:42.583336 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-0d521a5b-4202-46c1-9d2b-8525eeb2669e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:42.587564 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-0d521a5b-4202-46c1-9d2b-8525eeb2669e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:42.600985 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0d521a5b-4202-46c1-9d2b-8525eeb2669e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:42.601987 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0d521a5b-4202-46c1-9d2b-8525eeb2669e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:42.602712 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0d521a5b-4202-46c1-9d2b-8525eeb2669e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:42.605666 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0d521a5b-4202-46c1-9d2b-8525eeb2669e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:42.610829 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0d521a5b-4202-46c1-9d2b-8525eeb2669e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:42.610829 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0d521a5b-4202-46c1-9d2b-8525eeb2669e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:42.737492 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-0d521a5b-4202-46c1-9d2b-8525eeb2669e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:42.753031 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-0d521a5b-4202-46c1-9d2b-8525eeb2669e tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1511 microversion: 2.1 time: 0.174079 Aug 24 07:56:42.754114 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 75/150] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:42 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1511 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:42.765797 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-431b28e6-b43a-4539-8eb0-042de3cb2e10 req-c7ed2bf2-8c45-4a1f-8e57-6e395c8a5368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da017fd6-2861-4ef8-b216-cb16309cdf1b", "name": "network-vif-deleted", "tag": "cddb0d7e-7022-4a60-ba3b-4112336a886c"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:56:42.775640 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-431b28e6-b43a-4539-8eb0-042de3cb2e10 req-c7ed2bf2-8c45-4a1f-8e57-6e395c8a5368 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:42.776158 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-431b28e6-b43a-4539-8eb0-042de3cb2e10 req-c7ed2bf2-8c45-4a1f-8e57-6e395c8a5368 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:42.776629 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-431b28e6-b43a-4539-8eb0-042de3cb2e10 req-c7ed2bf2-8c45-4a1f-8e57-6e395c8a5368 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:42.790403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-431b28e6-b43a-4539-8eb0-042de3cb2e10 req-c7ed2bf2-8c45-4a1f-8e57-6e395c8a5368 service nova] Creating event network-vif-deleted:cddb0d7e-7022-4a60-ba3b-4112336a886c for instance da017fd6-2861-4ef8-b216-cb16309cdf1b on hv-cinder-85427 Aug 24 07:56:42.796005 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-431b28e6-b43a-4539-8eb0-042de3cb2e10 req-c7ed2bf2-8c45-4a1f-8e57-6e395c8a5368 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033861 Aug 24 07:56:42.799672 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 76/151] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:56:43.507980 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-24f64179-6795-42ba-b32b-85e5fb9558b4 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:43.508734 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-24f64179-6795-42ba-b32b-85e5fb9558b4 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:43.516042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-24f64179-6795-42ba-b32b-85e5fb9558b4 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:43.516748 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-24f64179-6795-42ba-b32b-85e5fb9558b4 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:43.517188 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-24f64179-6795-42ba-b32b-85e5fb9558b4 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:43.517892 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-24f64179-6795-42ba-b32b-85e5fb9558b4 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:43.518346 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-24f64179-6795-42ba-b32b-85e5fb9558b4 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:43.518766 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-24f64179-6795-42ba-b32b-85e5fb9558b4 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:43.575872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-e85c566a-e46f-46ab-af45-5d75e01b5422 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:43.576570 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-e85c566a-e46f-46ab-af45-5d75e01b5422 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:43.583733 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e85c566a-e46f-46ab-af45-5d75e01b5422 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:43.585347 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e85c566a-e46f-46ab-af45-5d75e01b5422 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:43.586171 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e85c566a-e46f-46ab-af45-5d75e01b5422 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:43.587004 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-24f64179-6795-42ba-b32b-85e5fb9558b4 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:43.590174 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e85c566a-e46f-46ab-af45-5d75e01b5422 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:43.590174 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e85c566a-e46f-46ab-af45-5d75e01b5422 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:43.590174 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e85c566a-e46f-46ab-af45-5d75e01b5422 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:43.600786 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-24f64179-6795-42ba-b32b-85e5fb9558b4 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 200 len: 1265 microversion: 2.1 time: 0.096509 Aug 24 07:56:43.601299 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 76/152] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:43 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 1265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:43.760912 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-e85c566a-e46f-46ab-af45-5d75e01b5422 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:43.768878 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-e85c566a-e46f-46ab-af45-5d75e01b5422 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.197200 Aug 24 07:56:43.769548 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 77/153] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:43 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:43.773367 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-050c26bc-c800-4e9c-94bc-d8110e7a0d96 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:43.773980 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-050c26bc-c800-4e9c-94bc-d8110e7a0d96 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:43.780484 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-050c26bc-c800-4e9c-94bc-d8110e7a0d96 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:43.781002 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-050c26bc-c800-4e9c-94bc-d8110e7a0d96 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:43.781438 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-050c26bc-c800-4e9c-94bc-d8110e7a0d96 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:43.782131 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-050c26bc-c800-4e9c-94bc-d8110e7a0d96 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:43.782581 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-050c26bc-c800-4e9c-94bc-d8110e7a0d96 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:43.783008 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-050c26bc-c800-4e9c-94bc-d8110e7a0d96 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:43.814446 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-050c26bc-c800-4e9c-94bc-d8110e7a0d96 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:43.814933 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-050c26bc-c800-4e9c-94bc-d8110e7a0d96 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:43.815365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-050c26bc-c800-4e9c-94bc-d8110e7a0d96 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:43.815818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.objects.instance [None req-050c26bc-c800-4e9c-94bc-d8110e7a0d96 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lazy-loading 'fault' on Instance uuid da017fd6-2861-4ef8-b216-cb16309cdf1b {{(pid=127589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:56:43.867362 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-050c26bc-c800-4e9c-94bc-d8110e7a0d96 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c772000142f14498933a685d3855bc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601816703e524795ab40b1dea9393870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:43.876013 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-050c26bc-c800-4e9c-94bc-d8110e7a0d96 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 200 len: 1350 microversion: 2.1 time: 0.106530 Aug 24 07:56:43.876586 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 77/154] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:43 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 1350 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:44.621844 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-6ff9c3a9-0456-4345-b632-ddcc6b3ee79d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:44.622455 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-6ff9c3a9-0456-4345-b632-ddcc6b3ee79d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:44.628805 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6ff9c3a9-0456-4345-b632-ddcc6b3ee79d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:44.629285 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6ff9c3a9-0456-4345-b632-ddcc6b3ee79d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:44.629885 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6ff9c3a9-0456-4345-b632-ddcc6b3ee79d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:44.630560 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6ff9c3a9-0456-4345-b632-ddcc6b3ee79d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:44.631011 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6ff9c3a9-0456-4345-b632-ddcc6b3ee79d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:44.631435 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6ff9c3a9-0456-4345-b632-ddcc6b3ee79d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:44.696395 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-6ff9c3a9-0456-4345-b632-ddcc6b3ee79d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:44.704971 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-6ff9c3a9-0456-4345-b632-ddcc6b3ee79d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 200 len: 1271 microversion: 2.1 time: 0.087030 Aug 24 07:56:44.705542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 78/155] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:44 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:44.790892 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-9b112845-f5c5-43d9-b1d7-7b7086a6bd33 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:44.791780 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-9b112845-f5c5-43d9-b1d7-7b7086a6bd33 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:44.799049 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9b112845-f5c5-43d9-b1d7-7b7086a6bd33 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:44.799629 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9b112845-f5c5-43d9-b1d7-7b7086a6bd33 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:44.800131 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9b112845-f5c5-43d9-b1d7-7b7086a6bd33 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:44.800869 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9b112845-f5c5-43d9-b1d7-7b7086a6bd33 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:44.801318 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9b112845-f5c5-43d9-b1d7-7b7086a6bd33 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:44.803630 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9b112845-f5c5-43d9-b1d7-7b7086a6bd33 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:44.900154 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-c97bf918-4966-4f36-8495-ec5aceaac2f3 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:44.901381 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-c97bf918-4966-4f36-8495-ec5aceaac2f3 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:44.914284 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c97bf918-4966-4f36-8495-ec5aceaac2f3 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:44.919978 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c97bf918-4966-4f36-8495-ec5aceaac2f3 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:44.919978 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c97bf918-4966-4f36-8495-ec5aceaac2f3 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:44.919978 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c97bf918-4966-4f36-8495-ec5aceaac2f3 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:44.919978 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c97bf918-4966-4f36-8495-ec5aceaac2f3 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:44.920338 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c97bf918-4966-4f36-8495-ec5aceaac2f3 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:44.937363 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.wsgi [None req-c97bf918-4966-4f36-8495-ec5aceaac2f3 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] HTTP exception thrown: Instance da017fd6-2861-4ef8-b216-cb16309cdf1b could not be found. Aug 24 07:56:44.942200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-c97bf918-4966-4f36-8495-ec5aceaac2f3 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Request method failure captured: Aug 24 07:56:44.942200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: request: GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b HTTP/1.1 Aug 24 07:56:44.942200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept: application/json Aug 24 07:56:44.942200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept-Encoding: identity Aug 24 07:56:44.942200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Connection: close Aug 24 07:56:44.942200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Length: 0 Aug 24 07:56:44.942200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Type: application/json Aug 24 07:56:44.942200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Host: 10.222.0.72 Aug 24 07:56:44.942200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Openstack-System-Scope: None Aug 24 07:56:44.942200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: User-Agent: python-urllib3/1.26.11 Aug 24 07:56:44.942200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Auth-Token: gAAAAABjBdl7LZY-gE7V4RSb8DjMA0ZogTmhpSOMWwrKazTY9WmnXGEc71IkdBseYobh5ktAvGzLW0q9-tSr3e5Y_-Vo5y6V8AtmeFrC6BnjzlxV7HDd-NWz5uMt1fAZaX9QiWsRhfaGl6qwMVVXDiliNLfbywxbCGIImE8ymu-bzXjF3GvqwJI Aug 24 07:56:44.942200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Id: None Aug 24 07:56:44.942200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Name: None Aug 24 07:56:44.942200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Identity-Status: Confirmed Aug 24 07:56:44.942200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Is-Admin-Project: True Aug 24 07:56:44.942200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Id: default Aug 24 07:56:44.942200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Name: Default Aug 24 07:56:44.942200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Id: 601816703e524795ab40b1dea9393870 Aug 24 07:56:44.942200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Name: tempest-DeleteServersTestJSON-1584699379 Aug 24 07:56:44.942200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Role: reader,member Aug 24 07:56:44.942200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Roles: reader,member Aug 24 07:56:44.949958 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_601816703e524795ab40b1dea9393870"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/601816703e524795ab40b1dea9393870"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/601816703e524795ab40b1dea9393870"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/601816703e524795ab40b1dea9393870"}]}] Aug 24 07:56:44.949958 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant: tempest-DeleteServersTestJSON-1584699379 Aug 24 07:56:44.949958 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Id: 601816703e524795ab40b1dea9393870 Aug 24 07:56:44.949958 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Name: tempest-DeleteServersTestJSON-1584699379 Aug 24 07:56:44.949958 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User: tempest-DeleteServersTestJSON-1584699379-project Aug 24 07:56:44.949958 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Id: default Aug 24 07:56:44.949958 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Name: Default Aug 24 07:56:44.949958 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Id: c772000142f14498933a685d3855bc02 Aug 24 07:56:44.949958 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Name: tempest-DeleteServersTestJSON-1584699379-project Aug 24 07:56:44.949958 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: method: > Aug 24 07:56:44.949958 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: exception: Instance da017fd6-2861-4ef8-b216-cb16309cdf1b could not be found. Aug 24 07:56:44.949958 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: action_args: {'id': 'da017fd6-2861-4ef8-b216-cb16309cdf1b'} Aug 24 07:56:44.951002 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:56:44.951002 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:56:44.951002 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:56:44.951002 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:56:44.951002 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:56:44.951002 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:56:44.951002 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:56:44.951002 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:56:44.951002 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:56:44.951002 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:56:44.951002 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da017fd6-2861-4ef8-b216-cb16309cdf1b could not be found. Aug 24 07:56:44.951002 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:56:44.951002 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:56:44.951002 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:56:44.951002 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:56:44.951002 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:56:44.951002 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:56:44.951002 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:56:44.951002 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:56:44.951002 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:56:44.953252 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:56:44.953252 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:56:44.953252 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:56:44.953252 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:56:44.953252 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:56:44.953252 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:56:44.953252 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:56:44.953252 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da017fd6-2861-4ef8-b216-cb16309cdf1b could not be found. Aug 24 07:56:44.953252 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:56:44.953252 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:56:44.953252 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:56:44.953252 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:56:44.953252 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:56:44.953252 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:56:44.953252 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:56:44.953252 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:56:44.953252 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da017fd6-2861-4ef8-b216-cb16309cdf1b could not be found. Aug 24 07:56:44.953252 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:56:44.954470 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-c97bf918-4966-4f36-8495-ec5aceaac2f3 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Returning 404 to user: Instance da017fd6-2861-4ef8-b216-cb16309cdf1b could not be found. {{(pid=127590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:56:44.954470 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-c97bf918-4966-4f36-8495-ec5aceaac2f3 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 404 len: 111 microversion: 2.1 time: 0.048604 Aug 24 07:56:44.954470 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 79/156] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:44 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:56:44.975963 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-9b112845-f5c5-43d9-b1d7-7b7086a6bd33 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:44.984481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-9b112845-f5c5-43d9-b1d7-7b7086a6bd33 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.197786 Aug 24 07:56:44.985071 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 78/157] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:44 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:45.074380 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-4b278b09-7ec4-4799-91cd-c78313dac7d1 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:45.078047 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-4b278b09-7ec4-4799-91cd-c78313dac7d1 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:45.086001 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4b278b09-7ec4-4799-91cd-c78313dac7d1 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:45.086583 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4b278b09-7ec4-4799-91cd-c78313dac7d1 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:45.087062 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4b278b09-7ec4-4799-91cd-c78313dac7d1 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:45.089548 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4b278b09-7ec4-4799-91cd-c78313dac7d1 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:45.089548 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4b278b09-7ec4-4799-91cd-c78313dac7d1 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:45.089548 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4b278b09-7ec4-4799-91cd-c78313dac7d1 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:45.104212 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.wsgi [None req-4b278b09-7ec4-4799-91cd-c78313dac7d1 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] HTTP exception thrown: Instance da017fd6-2861-4ef8-b216-cb16309cdf1b could not be found. Aug 24 07:56:45.106023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-4b278b09-7ec4-4799-91cd-c78313dac7d1 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Request method failure captured: Aug 24 07:56:45.106023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: request: GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b/os-volume_attachments HTTP/1.1 Aug 24 07:56:45.106023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept: application/json Aug 24 07:56:45.106023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept-Encoding: identity Aug 24 07:56:45.106023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Connection: close Aug 24 07:56:45.106023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Length: 0 Aug 24 07:56:45.106023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Type: application/json Aug 24 07:56:45.106023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Host: 10.222.0.72 Aug 24 07:56:45.106023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Openstack-System-Scope: None Aug 24 07:56:45.106023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: User-Agent: python-urllib3/1.26.11 Aug 24 07:56:45.106023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Auth-Token: gAAAAABjBdl7LZY-gE7V4RSb8DjMA0ZogTmhpSOMWwrKazTY9WmnXGEc71IkdBseYobh5ktAvGzLW0q9-tSr3e5Y_-Vo5y6V8AtmeFrC6BnjzlxV7HDd-NWz5uMt1fAZaX9QiWsRhfaGl6qwMVVXDiliNLfbywxbCGIImE8ymu-bzXjF3GvqwJI Aug 24 07:56:45.106023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Id: None Aug 24 07:56:45.106023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Name: None Aug 24 07:56:45.106023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Identity-Status: Confirmed Aug 24 07:56:45.106023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Is-Admin-Project: True Aug 24 07:56:45.106023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Id: default Aug 24 07:56:45.106023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Name: Default Aug 24 07:56:45.106023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Id: 601816703e524795ab40b1dea9393870 Aug 24 07:56:45.106023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Name: tempest-DeleteServersTestJSON-1584699379 Aug 24 07:56:45.106023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Role: reader,member Aug 24 07:56:45.106023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Roles: reader,member Aug 24 07:56:45.107415 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_601816703e524795ab40b1dea9393870"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/601816703e524795ab40b1dea9393870"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/601816703e524795ab40b1dea9393870"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/601816703e524795ab40b1dea9393870"}]}] Aug 24 07:56:45.107415 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant: tempest-DeleteServersTestJSON-1584699379 Aug 24 07:56:45.107415 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Id: 601816703e524795ab40b1dea9393870 Aug 24 07:56:45.107415 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Name: tempest-DeleteServersTestJSON-1584699379 Aug 24 07:56:45.107415 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User: tempest-DeleteServersTestJSON-1584699379-project Aug 24 07:56:45.107415 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Id: default Aug 24 07:56:45.107415 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Name: Default Aug 24 07:56:45.107415 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Id: c772000142f14498933a685d3855bc02 Aug 24 07:56:45.107415 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Name: tempest-DeleteServersTestJSON-1584699379-project Aug 24 07:56:45.107415 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: method: > Aug 24 07:56:45.107415 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: exception: Instance da017fd6-2861-4ef8-b216-cb16309cdf1b could not be found. Aug 24 07:56:45.107415 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: action_args: {'server_id': 'da017fd6-2861-4ef8-b216-cb16309cdf1b'} Aug 24 07:56:45.108172 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:56:45.108172 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:56:45.108172 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:56:45.108172 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:56:45.108172 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:56:45.108172 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:56:45.108172 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:56:45.108172 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:56:45.108172 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:56:45.108172 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:56:45.108172 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da017fd6-2861-4ef8-b216-cb16309cdf1b could not be found. Aug 24 07:56:45.108172 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:56:45.108172 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:56:45.108172 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:56:45.108172 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:56:45.108172 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:56:45.108172 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:56:45.108172 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:56:45.108172 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:56:45.108172 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:56:45.109344 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:56:45.109344 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 07:56:45.109344 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 07:56:45.109344 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 07:56:45.109344 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 07:56:45.109344 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 07:56:45.109344 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 07:56:45.109344 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:56:45.109344 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:56:45.109344 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da017fd6-2861-4ef8-b216-cb16309cdf1b could not be found. Aug 24 07:56:45.109344 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:56:45.109344 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:56:45.109344 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:56:45.109344 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:56:45.109344 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:56:45.109344 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:56:45.109344 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:56:45.109344 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:56:45.109344 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da017fd6-2861-4ef8-b216-cb16309cdf1b could not be found. Aug 24 07:56:45.109344 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:56:45.110534 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-4b278b09-7ec4-4799-91cd-c78313dac7d1 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Returning 404 to user: Instance da017fd6-2861-4ef8-b216-cb16309cdf1b could not be found. {{(pid=127590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:56:45.110534 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-4b278b09-7ec4-4799-91cd-c78313dac7d1 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038398 Aug 24 07:56:45.110534 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 80/158] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 24 07:56:45 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:56:45.730114 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-2b101a66-5601-467a-b2be-15bac1585199 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:45.730730 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-2b101a66-5601-467a-b2be-15bac1585199 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:45.736909 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2b101a66-5601-467a-b2be-15bac1585199 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:45.737698 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2b101a66-5601-467a-b2be-15bac1585199 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:45.738642 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2b101a66-5601-467a-b2be-15bac1585199 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:45.739711 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2b101a66-5601-467a-b2be-15bac1585199 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:45.740172 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2b101a66-5601-467a-b2be-15bac1585199 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:45.740973 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2b101a66-5601-467a-b2be-15bac1585199 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:45.871253 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-2b101a66-5601-467a-b2be-15bac1585199 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:45.879005 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-2b101a66-5601-467a-b2be-15bac1585199 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 200 len: 1313 microversion: 2.1 time: 0.153603 Aug 24 07:56:45.879480 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 79/159] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:45 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:46.005982 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-88be4ad1-224c-4fb8-8e86-477d53ed0498 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:46.006503 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-88be4ad1-224c-4fb8-8e86-477d53ed0498 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:46.013148 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-88be4ad1-224c-4fb8-8e86-477d53ed0498 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:46.013638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-88be4ad1-224c-4fb8-8e86-477d53ed0498 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:46.016199 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-88be4ad1-224c-4fb8-8e86-477d53ed0498 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:46.016199 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-88be4ad1-224c-4fb8-8e86-477d53ed0498 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:46.016199 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-88be4ad1-224c-4fb8-8e86-477d53ed0498 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:46.016199 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-88be4ad1-224c-4fb8-8e86-477d53ed0498 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:46.166204 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-88be4ad1-224c-4fb8-8e86-477d53ed0498 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:46.187435 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-88be4ad1-224c-4fb8-8e86-477d53ed0498 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.185450 Aug 24 07:56:46.188069 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 81/160] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:46 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:46.904206 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e34e46cc-95d8-4bb0-b82f-eeba395741f3 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:46.904901 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-e34e46cc-95d8-4bb0-b82f-eeba395741f3 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:46.912470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e34e46cc-95d8-4bb0-b82f-eeba395741f3 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:46.912993 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e34e46cc-95d8-4bb0-b82f-eeba395741f3 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:46.913427 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e34e46cc-95d8-4bb0-b82f-eeba395741f3 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:46.914229 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e34e46cc-95d8-4bb0-b82f-eeba395741f3 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:46.914677 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e34e46cc-95d8-4bb0-b82f-eeba395741f3 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:46.915096 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e34e46cc-95d8-4bb0-b82f-eeba395741f3 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:47.051752 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e34e46cc-95d8-4bb0-b82f-eeba395741f3 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:47.059618 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-e34e46cc-95d8-4bb0-b82f-eeba395741f3 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 200 len: 1313 microversion: 2.1 time: 0.160037 Aug 24 07:56:47.060184 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 80/161] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:46 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:47.217565 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-9ffb07fe-b5c8-4280-aacf-086cd8bcf189 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:47.218324 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-9ffb07fe-b5c8-4280-aacf-086cd8bcf189 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:47.225090 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9ffb07fe-b5c8-4280-aacf-086cd8bcf189 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:47.232978 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9ffb07fe-b5c8-4280-aacf-086cd8bcf189 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:47.232978 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9ffb07fe-b5c8-4280-aacf-086cd8bcf189 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:47.232978 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9ffb07fe-b5c8-4280-aacf-086cd8bcf189 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:47.232978 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9ffb07fe-b5c8-4280-aacf-086cd8bcf189 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:47.233388 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9ffb07fe-b5c8-4280-aacf-086cd8bcf189 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:47.381389 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9ffb07fe-b5c8-4280-aacf-086cd8bcf189 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:47.392840 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-9ffb07fe-b5c8-4280-aacf-086cd8bcf189 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.187904 Aug 24 07:56:47.393417 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 82/162] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:47 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:48.081513 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e9392f4b-570b-4822-8290-05affcac7eaf tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:48.082867 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-e9392f4b-570b-4822-8290-05affcac7eaf tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:48.089955 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e9392f4b-570b-4822-8290-05affcac7eaf tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:48.090645 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e9392f4b-570b-4822-8290-05affcac7eaf tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:48.091054 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e9392f4b-570b-4822-8290-05affcac7eaf tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:48.091863 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e9392f4b-570b-4822-8290-05affcac7eaf tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:48.092538 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e9392f4b-570b-4822-8290-05affcac7eaf tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:48.092927 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e9392f4b-570b-4822-8290-05affcac7eaf tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:48.296421 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e9392f4b-570b-4822-8290-05affcac7eaf tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:48.304394 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-e9392f4b-570b-4822-8290-05affcac7eaf tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 200 len: 1313 microversion: 2.1 time: 0.227152 Aug 24 07:56:48.305014 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 81/163] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:48 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:48.338825 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-59368ce9-53c9-43a5-8717-70704ca15781 req-0fd6fd5b-46b4-436d-b7cf-fd9ea9ff7b20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68ff8b45-89e5-410a-878e-3f13dd4aeb2a", "tag": "493fabbb-65d6-48e1-b2e1-894acb2f866c"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:56:48.357716 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-59368ce9-53c9-43a5-8717-70704ca15781 req-0fd6fd5b-46b4-436d-b7cf-fd9ea9ff7b20 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:48.358658 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-59368ce9-53c9-43a5-8717-70704ca15781 req-0fd6fd5b-46b4-436d-b7cf-fd9ea9ff7b20 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:48.359464 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-59368ce9-53c9-43a5-8717-70704ca15781 req-0fd6fd5b-46b4-436d-b7cf-fd9ea9ff7b20 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:48.374722 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-59368ce9-53c9-43a5-8717-70704ca15781 req-0fd6fd5b-46b4-436d-b7cf-fd9ea9ff7b20 service nova] Creating event network-changed:493fabbb-65d6-48e1-b2e1-894acb2f866c for instance 68ff8b45-89e5-410a-878e-3f13dd4aeb2a on hv-cinder-85427 Aug 24 07:56:48.384871 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-59368ce9-53c9-43a5-8717-70704ca15781 req-0fd6fd5b-46b4-436d-b7cf-fd9ea9ff7b20 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050849 Aug 24 07:56:48.385827 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 83/164] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:56:48.417094 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-4951ed98-cbfd-476a-bd3b-1e34fc4e5abd tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:48.423588 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-4951ed98-cbfd-476a-bd3b-1e34fc4e5abd tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:48.423900 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4951ed98-cbfd-476a-bd3b-1e34fc4e5abd tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:48.424618 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4951ed98-cbfd-476a-bd3b-1e34fc4e5abd tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:48.425081 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4951ed98-cbfd-476a-bd3b-1e34fc4e5abd tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:48.425775 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4951ed98-cbfd-476a-bd3b-1e34fc4e5abd tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:48.426230 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4951ed98-cbfd-476a-bd3b-1e34fc4e5abd tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:48.426653 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4951ed98-cbfd-476a-bd3b-1e34fc4e5abd tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:48.641766 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-af394e25-6842-4812-934d-8330ace14dba tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:48.643573 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-af394e25-6842-4812-934d-8330ace14dba tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:48.658666 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-af394e25-6842-4812-934d-8330ace14dba tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:48.659158 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-af394e25-6842-4812-934d-8330ace14dba tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:48.659985 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-af394e25-6842-4812-934d-8330ace14dba tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:48.661162 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-af394e25-6842-4812-934d-8330ace14dba tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:48.661772 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-af394e25-6842-4812-934d-8330ace14dba tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:48.662353 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-af394e25-6842-4812-934d-8330ace14dba tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:48.703580 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.wsgi [None req-af394e25-6842-4812-934d-8330ace14dba tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] HTTP exception thrown: Instance da017fd6-2861-4ef8-b216-cb16309cdf1b could not be found. Aug 24 07:56:48.706384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-af394e25-6842-4812-934d-8330ace14dba tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Request method failure captured: Aug 24 07:56:48.706384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: request: DELETE /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b HTTP/1.1 Aug 24 07:56:48.706384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept: application/json Aug 24 07:56:48.706384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept-Encoding: identity Aug 24 07:56:48.706384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Connection: close Aug 24 07:56:48.706384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Length: 0 Aug 24 07:56:48.706384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Type: application/json Aug 24 07:56:48.706384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Host: 10.222.0.72 Aug 24 07:56:48.706384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Openstack-System-Scope: None Aug 24 07:56:48.706384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: User-Agent: python-urllib3/1.26.11 Aug 24 07:56:48.706384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Auth-Token: gAAAAABjBdl7LZY-gE7V4RSb8DjMA0ZogTmhpSOMWwrKazTY9WmnXGEc71IkdBseYobh5ktAvGzLW0q9-tSr3e5Y_-Vo5y6V8AtmeFrC6BnjzlxV7HDd-NWz5uMt1fAZaX9QiWsRhfaGl6qwMVVXDiliNLfbywxbCGIImE8ymu-bzXjF3GvqwJI Aug 24 07:56:48.706384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Id: None Aug 24 07:56:48.706384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Name: None Aug 24 07:56:48.706384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Identity-Status: Confirmed Aug 24 07:56:48.706384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Is-Admin-Project: True Aug 24 07:56:48.706384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Id: default Aug 24 07:56:48.706384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Name: Default Aug 24 07:56:48.706384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Id: 601816703e524795ab40b1dea9393870 Aug 24 07:56:48.706384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Name: tempest-DeleteServersTestJSON-1584699379 Aug 24 07:56:48.706384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Role: reader,member Aug 24 07:56:48.706384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Roles: reader,member Aug 24 07:56:48.708434 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_601816703e524795ab40b1dea9393870"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/601816703e524795ab40b1dea9393870"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/601816703e524795ab40b1dea9393870"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/601816703e524795ab40b1dea9393870"}]}] Aug 24 07:56:48.708434 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant: tempest-DeleteServersTestJSON-1584699379 Aug 24 07:56:48.708434 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Id: 601816703e524795ab40b1dea9393870 Aug 24 07:56:48.708434 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Name: tempest-DeleteServersTestJSON-1584699379 Aug 24 07:56:48.708434 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User: tempest-DeleteServersTestJSON-1584699379-project Aug 24 07:56:48.708434 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Id: default Aug 24 07:56:48.708434 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Name: Default Aug 24 07:56:48.708434 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Id: c772000142f14498933a685d3855bc02 Aug 24 07:56:48.708434 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Name: tempest-DeleteServersTestJSON-1584699379-project Aug 24 07:56:48.708434 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: method: > Aug 24 07:56:48.708434 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: exception: Instance da017fd6-2861-4ef8-b216-cb16309cdf1b could not be found. Aug 24 07:56:48.708434 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: action_args: {'id': 'da017fd6-2861-4ef8-b216-cb16309cdf1b'} Aug 24 07:56:48.710068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:56:48.710068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:56:48.710068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:56:48.710068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:56:48.710068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:56:48.710068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:56:48.710068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:56:48.710068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:56:48.710068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:56:48.710068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:56:48.710068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da017fd6-2861-4ef8-b216-cb16309cdf1b could not be found. Aug 24 07:56:48.710068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:56:48.710068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:56:48.710068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:56:48.710068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:56:48.710068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:56:48.710068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:56:48.710068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:56:48.710068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:56:48.710068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:56:48.711720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:56:48.711720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 07:56:48.711720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 07:56:48.711720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 07:56:48.711720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 07:56:48.711720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:56:48.711720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:56:48.711720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:56:48.711720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:56:48.711720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da017fd6-2861-4ef8-b216-cb16309cdf1b could not be found. Aug 24 07:56:48.711720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:56:48.711720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:56:48.711720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:56:48.711720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:56:48.711720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:56:48.711720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:56:48.711720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:56:48.711720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:56:48.711720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da017fd6-2861-4ef8-b216-cb16309cdf1b could not be found. Aug 24 07:56:48.711720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:56:48.715281 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-af394e25-6842-4812-934d-8330ace14dba tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Returning 404 to user: Instance da017fd6-2861-4ef8-b216-cb16309cdf1b could not be found. {{(pid=127590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:56:48.715281 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-af394e25-6842-4812-934d-8330ace14dba tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "DELETE /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 404 len: 111 microversion: 2.1 time: 0.076810 Aug 24 07:56:48.715281 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 84/165] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 24 07:56:48 2022] DELETE /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:56:48.722278 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-02f2bb6a-6014-4e27-9a0c-2ada31ac1426 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:48.724712 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-02f2bb6a-6014-4e27-9a0c-2ada31ac1426 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] [instance: da017fd6-2861-4ef8-b216-cb16309cdf1b] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:48.735816 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-02f2bb6a-6014-4e27-9a0c-2ada31ac1426 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:48.736303 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-02f2bb6a-6014-4e27-9a0c-2ada31ac1426 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:48.736833 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-02f2bb6a-6014-4e27-9a0c-2ada31ac1426 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:48.737518 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-02f2bb6a-6014-4e27-9a0c-2ada31ac1426 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:48.738238 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-02f2bb6a-6014-4e27-9a0c-2ada31ac1426 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:48.738668 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-02f2bb6a-6014-4e27-9a0c-2ada31ac1426 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:48.771788 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.wsgi [None req-02f2bb6a-6014-4e27-9a0c-2ada31ac1426 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] HTTP exception thrown: Instance da017fd6-2861-4ef8-b216-cb16309cdf1b could not be found. Aug 24 07:56:48.777023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-02f2bb6a-6014-4e27-9a0c-2ada31ac1426 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Request method failure captured: Aug 24 07:56:48.777023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: request: GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b HTTP/1.1 Aug 24 07:56:48.777023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept: application/json Aug 24 07:56:48.777023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept-Encoding: identity Aug 24 07:56:48.777023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Connection: close Aug 24 07:56:48.777023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Length: 0 Aug 24 07:56:48.777023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Type: application/json Aug 24 07:56:48.777023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Host: 10.222.0.72 Aug 24 07:56:48.777023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Openstack-System-Scope: None Aug 24 07:56:48.777023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: User-Agent: python-urllib3/1.26.11 Aug 24 07:56:48.777023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Auth-Token: gAAAAABjBdl7LZY-gE7V4RSb8DjMA0ZogTmhpSOMWwrKazTY9WmnXGEc71IkdBseYobh5ktAvGzLW0q9-tSr3e5Y_-Vo5y6V8AtmeFrC6BnjzlxV7HDd-NWz5uMt1fAZaX9QiWsRhfaGl6qwMVVXDiliNLfbywxbCGIImE8ymu-bzXjF3GvqwJI Aug 24 07:56:48.777023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Id: None Aug 24 07:56:48.777023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Name: None Aug 24 07:56:48.777023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Identity-Status: Confirmed Aug 24 07:56:48.777023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Is-Admin-Project: True Aug 24 07:56:48.777023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Id: default Aug 24 07:56:48.777023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Name: Default Aug 24 07:56:48.777023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Id: 601816703e524795ab40b1dea9393870 Aug 24 07:56:48.777023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Name: tempest-DeleteServersTestJSON-1584699379 Aug 24 07:56:48.777023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Role: reader,member Aug 24 07:56:48.777023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Roles: reader,member Aug 24 07:56:48.778226 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_601816703e524795ab40b1dea9393870"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/601816703e524795ab40b1dea9393870"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/601816703e524795ab40b1dea9393870"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/601816703e524795ab40b1dea9393870"}]}] Aug 24 07:56:48.778226 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant: tempest-DeleteServersTestJSON-1584699379 Aug 24 07:56:48.778226 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Id: 601816703e524795ab40b1dea9393870 Aug 24 07:56:48.778226 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Name: tempest-DeleteServersTestJSON-1584699379 Aug 24 07:56:48.778226 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User: tempest-DeleteServersTestJSON-1584699379-project Aug 24 07:56:48.778226 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Id: default Aug 24 07:56:48.778226 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Name: Default Aug 24 07:56:48.778226 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Id: c772000142f14498933a685d3855bc02 Aug 24 07:56:48.778226 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Name: tempest-DeleteServersTestJSON-1584699379-project Aug 24 07:56:48.778226 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: method: > Aug 24 07:56:48.778226 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: exception: Instance da017fd6-2861-4ef8-b216-cb16309cdf1b could not be found. Aug 24 07:56:48.778226 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: action_args: {'id': 'da017fd6-2861-4ef8-b216-cb16309cdf1b'} Aug 24 07:56:48.778952 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:56:48.778952 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:56:48.778952 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:56:48.778952 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:56:48.778952 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:56:48.778952 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:56:48.778952 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:56:48.778952 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:56:48.778952 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:56:48.778952 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:56:48.778952 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da017fd6-2861-4ef8-b216-cb16309cdf1b could not be found. Aug 24 07:56:48.778952 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:56:48.778952 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:56:48.778952 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:56:48.778952 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:56:48.778952 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:56:48.778952 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:56:48.778952 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:56:48.778952 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:56:48.778952 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:56:48.780009 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:56:48.780009 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:56:48.780009 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:56:48.780009 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:56:48.780009 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:56:48.780009 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:56:48.780009 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:56:48.780009 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da017fd6-2861-4ef8-b216-cb16309cdf1b could not be found. Aug 24 07:56:48.780009 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:56:48.780009 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:56:48.780009 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:56:48.780009 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:56:48.780009 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:56:48.780009 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:56:48.780009 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:56:48.780009 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:56:48.780009 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da017fd6-2861-4ef8-b216-cb16309cdf1b could not be found. Aug 24 07:56:48.780009 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:56:48.781478 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-02f2bb6a-6014-4e27-9a0c-2ada31ac1426 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] Returning 404 to user: Instance da017fd6-2861-4ef8-b216-cb16309cdf1b could not be found. {{(pid=127590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:56:48.783529 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-02f2bb6a-6014-4e27-9a0c-2ada31ac1426 tempest-DeleteServersTestJSON-1584699379 tempest-DeleteServersTestJSON-1584699379-project] 10.222.0.72 "GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b" status: 404 len: 111 microversion: 2.1 time: 0.066067 Aug 24 07:56:48.787967 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 85/166] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:48 2022] GET /compute/v2.1/servers/da017fd6-2861-4ef8-b216-cb16309cdf1b => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:56:48.788108 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-4951ed98-cbfd-476a-bd3b-1e34fc4e5abd tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:48.805618 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-4951ed98-cbfd-476a-bd3b-1e34fc4e5abd tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.394575 Aug 24 07:56:48.819400 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 82/167] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:48 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:49.327867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-0afc90c2-536e-40ce-b76c-a8b094ed90f5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:49.328581 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-0afc90c2-536e-40ce-b76c-a8b094ed90f5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:49.344455 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0afc90c2-536e-40ce-b76c-a8b094ed90f5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:49.345867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0afc90c2-536e-40ce-b76c-a8b094ed90f5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:49.346317 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0afc90c2-536e-40ce-b76c-a8b094ed90f5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:49.349584 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0afc90c2-536e-40ce-b76c-a8b094ed90f5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:49.350211 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0afc90c2-536e-40ce-b76c-a8b094ed90f5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:49.352586 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0afc90c2-536e-40ce-b76c-a8b094ed90f5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:49.738360 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-0afc90c2-536e-40ce-b76c-a8b094ed90f5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:49.750235 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-0afc90c2-536e-40ce-b76c-a8b094ed90f5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 200 len: 1313 microversion: 2.1 time: 0.426538 Aug 24 07:56:49.751057 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 86/168] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:49 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 1313 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:49.826973 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-cc449b51-45a1-4332-95b1-121a81d63d2d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:49.827960 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-cc449b51-45a1-4332-95b1-121a81d63d2d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:49.835821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc449b51-45a1-4332-95b1-121a81d63d2d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:49.836470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc449b51-45a1-4332-95b1-121a81d63d2d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:49.837375 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc449b51-45a1-4332-95b1-121a81d63d2d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:49.838797 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc449b51-45a1-4332-95b1-121a81d63d2d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:49.839435 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc449b51-45a1-4332-95b1-121a81d63d2d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:49.840002 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc449b51-45a1-4332-95b1-121a81d63d2d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:50.005611 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-cc449b51-45a1-4332-95b1-121a81d63d2d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:50.016041 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-cc449b51-45a1-4332-95b1-121a81d63d2d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.192775 Aug 24 07:56:50.017015 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 83/169] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:49 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:50.771488 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-c2cedf7c-f68d-4237-8f43-962e2ab785da tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:50.772098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-c2cedf7c-f68d-4237-8f43-962e2ab785da tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:50.774152 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=2 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:50.774827 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=8 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:50.780354 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c2cedf7c-f68d-4237-8f43-962e2ab785da tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:50.780887 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c2cedf7c-f68d-4237-8f43-962e2ab785da tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:50.781496 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c2cedf7c-f68d-4237-8f43-962e2ab785da tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:50.782193 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c2cedf7c-f68d-4237-8f43-962e2ab785da tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:50.782781 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c2cedf7c-f68d-4237-8f43-962e2ab785da tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:50.783370 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c2cedf7c-f68d-4237-8f43-962e2ab785da tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:51.041050 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-c2cedf7c-f68d-4237-8f43-962e2ab785da tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:51.049763 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-8d6974bb-bc1c-4f38-af90-f678ebf1e735 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:51.050603 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-8d6974bb-bc1c-4f38-af90-f678ebf1e735 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:51.054451 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-c2cedf7c-f68d-4237-8f43-962e2ab785da tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 200 len: 1313 microversion: 2.1 time: 0.286448 Aug 24 07:56:51.057342 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 87/170] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:50 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:51.058767 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8d6974bb-bc1c-4f38-af90-f678ebf1e735 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:51.059260 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8d6974bb-bc1c-4f38-af90-f678ebf1e735 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:51.059765 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8d6974bb-bc1c-4f38-af90-f678ebf1e735 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:51.060846 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8d6974bb-bc1c-4f38-af90-f678ebf1e735 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:51.062893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8d6974bb-bc1c-4f38-af90-f678ebf1e735 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:51.063620 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8d6974bb-bc1c-4f38-af90-f678ebf1e735 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:51.385414 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-8d6974bb-bc1c-4f38-af90-f678ebf1e735 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:51.394909 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-8d6974bb-bc1c-4f38-af90-f678ebf1e735 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.350553 Aug 24 07:56:51.395871 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 84/171] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:51 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:52.077182 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-7f187631-db1a-48eb-a26c-62a66ebd0b97 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:52.078548 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-7f187631-db1a-48eb-a26c-62a66ebd0b97 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:52.085813 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7f187631-db1a-48eb-a26c-62a66ebd0b97 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:52.087191 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7f187631-db1a-48eb-a26c-62a66ebd0b97 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:52.088361 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7f187631-db1a-48eb-a26c-62a66ebd0b97 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:52.089530 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7f187631-db1a-48eb-a26c-62a66ebd0b97 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:52.090199 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7f187631-db1a-48eb-a26c-62a66ebd0b97 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:52.090822 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7f187631-db1a-48eb-a26c-62a66ebd0b97 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:52.242524 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-7f187631-db1a-48eb-a26c-62a66ebd0b97 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:52.250873 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-7f187631-db1a-48eb-a26c-62a66ebd0b97 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 200 len: 1313 microversion: 2.1 time: 0.178771 Aug 24 07:56:52.251464 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 88/172] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:52 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:52.415980 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-4b2d4912-5899-45fd-ba90-9526394695b5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:52.421493 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-4b2d4912-5899-45fd-ba90-9526394695b5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:52.423101 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4b2d4912-5899-45fd-ba90-9526394695b5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:52.423611 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4b2d4912-5899-45fd-ba90-9526394695b5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:52.424030 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4b2d4912-5899-45fd-ba90-9526394695b5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:52.424760 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4b2d4912-5899-45fd-ba90-9526394695b5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:52.425215 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4b2d4912-5899-45fd-ba90-9526394695b5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:52.425640 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4b2d4912-5899-45fd-ba90-9526394695b5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:52.568988 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-4b2d4912-5899-45fd-ba90-9526394695b5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:52.578032 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-4b2d4912-5899-45fd-ba90-9526394695b5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.165853 Aug 24 07:56:52.578604 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 85/173] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:52 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:53.271509 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-7d8d3a8a-daee-433d-bc74-f2bc21bba34b tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:53.272144 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-7d8d3a8a-daee-433d-bc74-f2bc21bba34b tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:53.278186 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d8d3a8a-daee-433d-bc74-f2bc21bba34b tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:53.278844 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d8d3a8a-daee-433d-bc74-f2bc21bba34b tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:53.279313 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d8d3a8a-daee-433d-bc74-f2bc21bba34b tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:53.280015 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d8d3a8a-daee-433d-bc74-f2bc21bba34b tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:53.280516 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d8d3a8a-daee-433d-bc74-f2bc21bba34b tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:53.280970 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d8d3a8a-daee-433d-bc74-f2bc21bba34b tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:53.285062 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=100 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:53.534606 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-7d8d3a8a-daee-433d-bc74-f2bc21bba34b tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:53.542946 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-7d8d3a8a-daee-433d-bc74-f2bc21bba34b tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 200 len: 1313 microversion: 2.1 time: 0.275215 Aug 24 07:56:53.543529 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 89/174] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:53 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:53.607871 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-2c13fade-9373-441b-8e89-6d640938a2ad tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:53.608577 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-2c13fade-9373-441b-8e89-6d640938a2ad tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:53.615811 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2c13fade-9373-441b-8e89-6d640938a2ad tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:53.624241 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2c13fade-9373-441b-8e89-6d640938a2ad tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:53.624241 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2c13fade-9373-441b-8e89-6d640938a2ad tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:53.624241 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2c13fade-9373-441b-8e89-6d640938a2ad tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:53.624241 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2c13fade-9373-441b-8e89-6d640938a2ad tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:53.624689 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2c13fade-9373-441b-8e89-6d640938a2ad tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:53.763234 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-2c13fade-9373-441b-8e89-6d640938a2ad tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:53.771326 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-2c13fade-9373-441b-8e89-6d640938a2ad tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.167273 Aug 24 07:56:53.771902 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 86/175] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:53 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:54.565312 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-1fb23a4b-5e5b-45a1-a0ea-7a114183d239 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:54.566002 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-1fb23a4b-5e5b-45a1-a0ea-7a114183d239 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:54.572639 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1fb23a4b-5e5b-45a1-a0ea-7a114183d239 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:54.573139 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1fb23a4b-5e5b-45a1-a0ea-7a114183d239 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:54.573757 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1fb23a4b-5e5b-45a1-a0ea-7a114183d239 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:54.574446 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1fb23a4b-5e5b-45a1-a0ea-7a114183d239 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:54.575046 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1fb23a4b-5e5b-45a1-a0ea-7a114183d239 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:54.575612 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1fb23a4b-5e5b-45a1-a0ea-7a114183d239 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:54.725490 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-1fb23a4b-5e5b-45a1-a0ea-7a114183d239 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:54.735839 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-1fb23a4b-5e5b-45a1-a0ea-7a114183d239 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 200 len: 1313 microversion: 2.1 time: 0.176128 Aug 24 07:56:54.736569 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 90/176] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:54 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:54.792555 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-d8d588e7-7ed8-4797-afab-d37d07b11fda tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:54.793161 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-d8d588e7-7ed8-4797-afab-d37d07b11fda tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:54.799932 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d8d588e7-7ed8-4797-afab-d37d07b11fda tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:54.800421 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d8d588e7-7ed8-4797-afab-d37d07b11fda tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:54.800936 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d8d588e7-7ed8-4797-afab-d37d07b11fda tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:54.801661 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d8d588e7-7ed8-4797-afab-d37d07b11fda tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:54.802164 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d8d588e7-7ed8-4797-afab-d37d07b11fda tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:54.802601 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d8d588e7-7ed8-4797-afab-d37d07b11fda tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:54.939627 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-d8d588e7-7ed8-4797-afab-d37d07b11fda tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:54.948246 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-d8d588e7-7ed8-4797-afab-d37d07b11fda tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.159767 Aug 24 07:56:54.948832 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 87/177] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:54 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:55.368396 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-9367f251-6837-4cbe-8102-96dcff08610c req-fbbaa8a5-31b9-413e-9582-c35a7fd20ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68ff8b45-89e5-410a-878e-3f13dd4aeb2a", "name": "network-vif-plugged", "status": "completed", "tag": "493fabbb-65d6-48e1-b2e1-894acb2f866c"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:56:55.396874 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-9367f251-6837-4cbe-8102-96dcff08610c req-fbbaa8a5-31b9-413e-9582-c35a7fd20ff1 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:55.397441 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-9367f251-6837-4cbe-8102-96dcff08610c req-fbbaa8a5-31b9-413e-9582-c35a7fd20ff1 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:55.398692 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-9367f251-6837-4cbe-8102-96dcff08610c req-fbbaa8a5-31b9-413e-9582-c35a7fd20ff1 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:55.426892 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-9367f251-6837-4cbe-8102-96dcff08610c req-fbbaa8a5-31b9-413e-9582-c35a7fd20ff1 service nova] Creating event network-vif-plugged:493fabbb-65d6-48e1-b2e1-894acb2f866c for instance 68ff8b45-89e5-410a-878e-3f13dd4aeb2a on hv-cinder-85427 Aug 24 07:56:55.432862 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-9367f251-6837-4cbe-8102-96dcff08610c req-fbbaa8a5-31b9-413e-9582-c35a7fd20ff1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068096 Aug 24 07:56:55.433429 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 91/178] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:56:55.760856 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-c12ee18f-09d8-4fb6-af12-f915de420ae1 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:55.761652 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-c12ee18f-09d8-4fb6-af12-f915de420ae1 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:55.767919 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c12ee18f-09d8-4fb6-af12-f915de420ae1 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:55.768601 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c12ee18f-09d8-4fb6-af12-f915de420ae1 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:55.769231 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c12ee18f-09d8-4fb6-af12-f915de420ae1 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:55.770383 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c12ee18f-09d8-4fb6-af12-f915de420ae1 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:55.771151 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c12ee18f-09d8-4fb6-af12-f915de420ae1 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:55.771731 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c12ee18f-09d8-4fb6-af12-f915de420ae1 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:55.973320 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-2edf1e0c-1640-43e3-ae59-a9fedce766aa tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:55.974715 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-2edf1e0c-1640-43e3-ae59-a9fedce766aa tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:55.983970 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2edf1e0c-1640-43e3-ae59-a9fedce766aa tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:55.984884 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2edf1e0c-1640-43e3-ae59-a9fedce766aa tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:55.985585 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2edf1e0c-1640-43e3-ae59-a9fedce766aa tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:55.986529 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2edf1e0c-1640-43e3-ae59-a9fedce766aa tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:55.987226 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2edf1e0c-1640-43e3-ae59-a9fedce766aa tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:55.987867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2edf1e0c-1640-43e3-ae59-a9fedce766aa tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:56.021653 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-c12ee18f-09d8-4fb6-af12-f915de420ae1 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:56.033069 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-c12ee18f-09d8-4fb6-af12-f915de420ae1 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 200 len: 1313 microversion: 2.1 time: 0.276148 Aug 24 07:56:56.034796 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 88/179] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:55 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:56.163122 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-2edf1e0c-1640-43e3-ae59-a9fedce766aa tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:56.171648 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-2edf1e0c-1640-43e3-ae59-a9fedce766aa tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.205196 Aug 24 07:56:56.172451 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 92/180] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:55 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:57.057042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-d91421cb-036d-4f00-bfab-46fc258c7cc6 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:57.057684 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-d91421cb-036d-4f00-bfab-46fc258c7cc6 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:57.064216 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d91421cb-036d-4f00-bfab-46fc258c7cc6 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:57.064922 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d91421cb-036d-4f00-bfab-46fc258c7cc6 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:57.065353 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d91421cb-036d-4f00-bfab-46fc258c7cc6 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:57.066061 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d91421cb-036d-4f00-bfab-46fc258c7cc6 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:57.066508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d91421cb-036d-4f00-bfab-46fc258c7cc6 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:57.066925 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d91421cb-036d-4f00-bfab-46fc258c7cc6 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:57.085481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=100 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:57.195913 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-88140ad9-16e1-47b9-8dc3-39c76c22d462 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:57.197853 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-88140ad9-16e1-47b9-8dc3-39c76c22d462 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:57.201074 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-d91421cb-036d-4f00-bfab-46fc258c7cc6 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:57.207195 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-88140ad9-16e1-47b9-8dc3-39c76c22d462 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:57.207195 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-88140ad9-16e1-47b9-8dc3-39c76c22d462 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:57.207195 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-88140ad9-16e1-47b9-8dc3-39c76c22d462 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:57.207195 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-88140ad9-16e1-47b9-8dc3-39c76c22d462 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:57.207798 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-88140ad9-16e1-47b9-8dc3-39c76c22d462 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:57.207798 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-88140ad9-16e1-47b9-8dc3-39c76c22d462 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:57.210582 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-d91421cb-036d-4f00-bfab-46fc258c7cc6 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 200 len: 1313 microversion: 2.1 time: 0.158362 Aug 24 07:56:57.211248 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 89/181] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:57 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:57.335775 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-88140ad9-16e1-47b9-8dc3-39c76c22d462 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:57.343507 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-88140ad9-16e1-47b9-8dc3-39c76c22d462 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.151593 Aug 24 07:56:57.344068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 93/182] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:57 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:58.231857 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-0ffa6b88-5bfa-4496-989c-cb03f1b5eaf9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:58.232490 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-0ffa6b88-5bfa-4496-989c-cb03f1b5eaf9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:58.239107 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0ffa6b88-5bfa-4496-989c-cb03f1b5eaf9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:58.239594 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0ffa6b88-5bfa-4496-989c-cb03f1b5eaf9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:58.240028 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0ffa6b88-5bfa-4496-989c-cb03f1b5eaf9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:58.240760 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0ffa6b88-5bfa-4496-989c-cb03f1b5eaf9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:58.241220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0ffa6b88-5bfa-4496-989c-cb03f1b5eaf9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:58.241646 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0ffa6b88-5bfa-4496-989c-cb03f1b5eaf9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:58.371181 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-4dbd0ea9-8925-470e-bba1-d0ac8711e42e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:58.371624 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-4dbd0ea9-8925-470e-bba1-d0ac8711e42e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:58.374488 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-0ffa6b88-5bfa-4496-989c-cb03f1b5eaf9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:58.379465 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4dbd0ea9-8925-470e-bba1-d0ac8711e42e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:58.379951 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4dbd0ea9-8925-470e-bba1-d0ac8711e42e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:58.380382 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4dbd0ea9-8925-470e-bba1-d0ac8711e42e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:58.381249 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4dbd0ea9-8925-470e-bba1-d0ac8711e42e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:58.381690 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4dbd0ea9-8925-470e-bba1-d0ac8711e42e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:58.382104 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4dbd0ea9-8925-470e-bba1-d0ac8711e42e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:58.382683 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-0ffa6b88-5bfa-4496-989c-cb03f1b5eaf9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 200 len: 1313 microversion: 2.1 time: 0.155044 Aug 24 07:56:58.383637 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 90/183] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:58 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:58.518623 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-4dbd0ea9-8925-470e-bba1-d0ac8711e42e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:58.527639 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-4dbd0ea9-8925-470e-bba1-d0ac8711e42e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.166728 Aug 24 07:56:58.528001 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 94/184] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:58 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:59.403739 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-1d2234b6-de79-4768-8a74-7b2b4049f559 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:59.404401 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-1d2234b6-de79-4768-8a74-7b2b4049f559 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:59.411168 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1d2234b6-de79-4768-8a74-7b2b4049f559 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:59.411654 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1d2234b6-de79-4768-8a74-7b2b4049f559 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:59.412089 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1d2234b6-de79-4768-8a74-7b2b4049f559 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:59.412821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1d2234b6-de79-4768-8a74-7b2b4049f559 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:59.413292 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1d2234b6-de79-4768-8a74-7b2b4049f559 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:59.419792 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1d2234b6-de79-4768-8a74-7b2b4049f559 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:59.549613 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-2a36b8ca-2f31-439e-a3b8-a2727543808f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:59.550428 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-2a36b8ca-2f31-439e-a3b8-a2727543808f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:59.553949 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-1d2234b6-de79-4768-8a74-7b2b4049f559 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:59.559266 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2a36b8ca-2f31-439e-a3b8-a2727543808f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:59.559765 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2a36b8ca-2f31-439e-a3b8-a2727543808f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:59.560211 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2a36b8ca-2f31-439e-a3b8-a2727543808f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:59.560951 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2a36b8ca-2f31-439e-a3b8-a2727543808f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:59.561404 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2a36b8ca-2f31-439e-a3b8-a2727543808f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:59.561829 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2a36b8ca-2f31-439e-a3b8-a2727543808f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:59.562647 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-1d2234b6-de79-4768-8a74-7b2b4049f559 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 200 len: 1313 microversion: 2.1 time: 0.163023 Aug 24 07:56:59.563233 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 91/185] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:59 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:59.694532 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-2a36b8ca-2f31-439e-a3b8-a2727543808f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:59.703785 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-2a36b8ca-2f31-439e-a3b8-a2727543808f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.159276 Aug 24 07:56:59.704380 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 95/186] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:59 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:00.583128 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-3e0e253f-5564-4c05-87f9-e571e0da4344 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:00.583744 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-3e0e253f-5564-4c05-87f9-e571e0da4344 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:00.590557 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3e0e253f-5564-4c05-87f9-e571e0da4344 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:00.591035 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3e0e253f-5564-4c05-87f9-e571e0da4344 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:00.591491 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3e0e253f-5564-4c05-87f9-e571e0da4344 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:00.592183 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3e0e253f-5564-4c05-87f9-e571e0da4344 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:00.592629 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3e0e253f-5564-4c05-87f9-e571e0da4344 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:00.593082 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3e0e253f-5564-4c05-87f9-e571e0da4344 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:00.725265 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-97b9e61c-2068-449b-8efc-77d988cbe67c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:00.725918 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-97b9e61c-2068-449b-8efc-77d988cbe67c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:00.730759 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-3e0e253f-5564-4c05-87f9-e571e0da4344 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:00.732467 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-97b9e61c-2068-449b-8efc-77d988cbe67c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:00.732976 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-97b9e61c-2068-449b-8efc-77d988cbe67c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:00.733417 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-97b9e61c-2068-449b-8efc-77d988cbe67c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:00.734107 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-97b9e61c-2068-449b-8efc-77d988cbe67c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:00.734559 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-97b9e61c-2068-449b-8efc-77d988cbe67c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:00.734983 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-97b9e61c-2068-449b-8efc-77d988cbe67c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:00.738724 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-3e0e253f-5564-4c05-87f9-e571e0da4344 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 200 len: 1313 microversion: 2.1 time: 0.159324 Aug 24 07:57:00.739291 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 92/187] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:00 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:00.875346 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-97b9e61c-2068-449b-8efc-77d988cbe67c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:00.883160 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-97b9e61c-2068-449b-8efc-77d988cbe67c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.161757 Aug 24 07:57:00.883718 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 96/188] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:00 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:01.760080 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-c7fbb931-bf1c-468a-adc6-d29833b5b0ff tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:01.760783 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-c7fbb931-bf1c-468a-adc6-d29833b5b0ff tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:01.767373 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c7fbb931-bf1c-468a-adc6-d29833b5b0ff tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:01.767860 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c7fbb931-bf1c-468a-adc6-d29833b5b0ff tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:01.768299 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c7fbb931-bf1c-468a-adc6-d29833b5b0ff tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:01.769040 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c7fbb931-bf1c-468a-adc6-d29833b5b0ff tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:01.769495 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c7fbb931-bf1c-468a-adc6-d29833b5b0ff tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:01.769919 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c7fbb931-bf1c-468a-adc6-d29833b5b0ff tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:01.901763 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-c7fbb931-bf1c-468a-adc6-d29833b5b0ff tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:01.903739 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-a4e2dd7c-77c7-45c3-ad7e-53808457edab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:01.904453 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-a4e2dd7c-77c7-45c3-ad7e-53808457edab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:01.916294 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-c7fbb931-bf1c-468a-adc6-d29833b5b0ff tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 200 len: 1313 microversion: 2.1 time: 0.154660 Aug 24 07:57:01.916294 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 93/189] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:01 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:01.916551 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a4e2dd7c-77c7-45c3-ad7e-53808457edab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:01.916551 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a4e2dd7c-77c7-45c3-ad7e-53808457edab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:01.916551 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a4e2dd7c-77c7-45c3-ad7e-53808457edab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:01.916551 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a4e2dd7c-77c7-45c3-ad7e-53808457edab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:01.916851 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a4e2dd7c-77c7-45c3-ad7e-53808457edab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:01.916851 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a4e2dd7c-77c7-45c3-ad7e-53808457edab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:02.048396 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-a4e2dd7c-77c7-45c3-ad7e-53808457edab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:02.057038 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-a4e2dd7c-77c7-45c3-ad7e-53808457edab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.157574 Aug 24 07:57:02.057599 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 97/190] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:01 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:02.933334 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-36f399dc-98c0-4ffe-a8b3-5984e02af20a tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:02.933956 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-36f399dc-98c0-4ffe-a8b3-5984e02af20a tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:02.940966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-36f399dc-98c0-4ffe-a8b3-5984e02af20a tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:02.941478 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-36f399dc-98c0-4ffe-a8b3-5984e02af20a tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:02.941897 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-36f399dc-98c0-4ffe-a8b3-5984e02af20a tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:02.942599 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-36f399dc-98c0-4ffe-a8b3-5984e02af20a tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:02.943102 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-36f399dc-98c0-4ffe-a8b3-5984e02af20a tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:02.943527 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-36f399dc-98c0-4ffe-a8b3-5984e02af20a tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:03.077882 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-85fe64be-d413-4818-bcce-c7a5f2ed1da8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:03.078507 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-85fe64be-d413-4818-bcce-c7a5f2ed1da8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:03.080177 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-36f399dc-98c0-4ffe-a8b3-5984e02af20a tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:03.085001 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-85fe64be-d413-4818-bcce-c7a5f2ed1da8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:03.085478 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-85fe64be-d413-4818-bcce-c7a5f2ed1da8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:03.085908 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-85fe64be-d413-4818-bcce-c7a5f2ed1da8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:03.086599 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-85fe64be-d413-4818-bcce-c7a5f2ed1da8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:03.087583 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-85fe64be-d413-4818-bcce-c7a5f2ed1da8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:03.088002 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-85fe64be-d413-4818-bcce-c7a5f2ed1da8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:03.088954 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-36f399dc-98c0-4ffe-a8b3-5984e02af20a tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 200 len: 1313 microversion: 2.1 time: 0.160318 Aug 24 07:57:03.089720 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 94/191] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:02 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:03.225836 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-85fe64be-d413-4818-bcce-c7a5f2ed1da8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:03.234458 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-85fe64be-d413-4818-bcce-c7a5f2ed1da8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.160340 Aug 24 07:57:03.235456 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 98/192] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:03 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:04.109976 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-1631f078-e724-4dab-a70d-2255ab70f5f2 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:04.110585 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-1631f078-e724-4dab-a70d-2255ab70f5f2 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:04.117318 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1631f078-e724-4dab-a70d-2255ab70f5f2 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:04.117801 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1631f078-e724-4dab-a70d-2255ab70f5f2 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:04.118257 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1631f078-e724-4dab-a70d-2255ab70f5f2 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:04.119738 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1631f078-e724-4dab-a70d-2255ab70f5f2 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:04.120191 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1631f078-e724-4dab-a70d-2255ab70f5f2 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:04.120807 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1631f078-e724-4dab-a70d-2255ab70f5f2 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:04.256594 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-c0004025-2a20-4858-ba62-fa02280acf03 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:04.258209 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-c0004025-2a20-4858-ba62-fa02280acf03 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:04.267587 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c0004025-2a20-4858-ba62-fa02280acf03 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:04.268087 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c0004025-2a20-4858-ba62-fa02280acf03 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:04.268762 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c0004025-2a20-4858-ba62-fa02280acf03 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:04.269688 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c0004025-2a20-4858-ba62-fa02280acf03 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:04.270385 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c0004025-2a20-4858-ba62-fa02280acf03 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:04.270993 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c0004025-2a20-4858-ba62-fa02280acf03 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:04.327555 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-1631f078-e724-4dab-a70d-2255ab70f5f2 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:04.337003 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-1631f078-e724-4dab-a70d-2255ab70f5f2 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 200 len: 1497 microversion: 2.1 time: 0.230720 Aug 24 07:57:04.347579 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 95/193] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:04 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 1497 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:04.421994 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-c0004025-2a20-4858-ba62-fa02280acf03 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:04.450901 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-c0004025-2a20-4858-ba62-fa02280acf03 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.198977 Aug 24 07:57:04.451486 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 99/194] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:04 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:05.479468 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-6861e58c-4348-44c3-852c-01366c926d57 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:05.480074 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-6861e58c-4348-44c3-852c-01366c926d57 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:05.486377 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6861e58c-4348-44c3-852c-01366c926d57 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:05.486848 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6861e58c-4348-44c3-852c-01366c926d57 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:05.487277 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6861e58c-4348-44c3-852c-01366c926d57 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:05.487953 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6861e58c-4348-44c3-852c-01366c926d57 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:05.488400 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6861e58c-4348-44c3-852c-01366c926d57 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:05.488935 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6861e58c-4348-44c3-852c-01366c926d57 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:05.633381 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-6861e58c-4348-44c3-852c-01366c926d57 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:05.644743 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-6861e58c-4348-44c3-852c-01366c926d57 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.166792 Aug 24 07:57:05.644743 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 96/195] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:05 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:06.663454 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-3c0246a0-ce13-415e-9fd5-7ae0746753d0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:06.664053 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-3c0246a0-ce13-415e-9fd5-7ae0746753d0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:06.670014 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3c0246a0-ce13-415e-9fd5-7ae0746753d0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:06.670484 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3c0246a0-ce13-415e-9fd5-7ae0746753d0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:06.670910 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3c0246a0-ce13-415e-9fd5-7ae0746753d0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:06.671591 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3c0246a0-ce13-415e-9fd5-7ae0746753d0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:06.672034 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3c0246a0-ce13-415e-9fd5-7ae0746753d0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:06.672451 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3c0246a0-ce13-415e-9fd5-7ae0746753d0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:06.807909 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-3c0246a0-ce13-415e-9fd5-7ae0746753d0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:06.815583 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-3c0246a0-ce13-415e-9fd5-7ae0746753d0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.156123 Aug 24 07:57:06.816140 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 100/196] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:06 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:07.837199 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-8ee075ae-520d-454c-bf5a-b5f37a12ae47 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:07.837823 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-8ee075ae-520d-454c-bf5a-b5f37a12ae47 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:07.844244 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8ee075ae-520d-454c-bf5a-b5f37a12ae47 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:07.844766 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8ee075ae-520d-454c-bf5a-b5f37a12ae47 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:07.845207 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8ee075ae-520d-454c-bf5a-b5f37a12ae47 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:07.845934 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8ee075ae-520d-454c-bf5a-b5f37a12ae47 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:07.846393 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8ee075ae-520d-454c-bf5a-b5f37a12ae47 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:07.846820 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8ee075ae-520d-454c-bf5a-b5f37a12ae47 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:07.978286 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-8ee075ae-520d-454c-bf5a-b5f37a12ae47 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:07.986242 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-8ee075ae-520d-454c-bf5a-b5f37a12ae47 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1521 microversion: 2.1 time: 0.153476 Aug 24 07:57:07.986799 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 97/197] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:07 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:08.033982 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-28c59f81-ddfc-452a-a000-b7e7a3a3d4b8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:08.034515 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-28c59f81-ddfc-452a-a000-b7e7a3a3d4b8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:08.041258 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-28c59f81-ddfc-452a-a000-b7e7a3a3d4b8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:08.041764 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-28c59f81-ddfc-452a-a000-b7e7a3a3d4b8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:08.042194 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-28c59f81-ddfc-452a-a000-b7e7a3a3d4b8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:08.042878 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-28c59f81-ddfc-452a-a000-b7e7a3a3d4b8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:08.043325 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-28c59f81-ddfc-452a-a000-b7e7a3a3d4b8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:08.043765 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-28c59f81-ddfc-452a-a000-b7e7a3a3d4b8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:08.069903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-28c59f81-ddfc-452a-a000-b7e7a3a3d4b8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Going to try to terminate instance {{(pid=127590) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:57:08.477019 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-28c59f81-ddfc-452a-a000-b7e7a3a3d4b8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "DELETE /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 204 len: 0 microversion: 2.1 time: 0.446905 Aug 24 07:57:08.479035 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 101/198] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 24 07:57:08 2022] DELETE /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:57:08.487148 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e8733e35-ed19-4264-8824-93ebee746e06 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:08.487754 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-e8733e35-ed19-4264-8824-93ebee746e06 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:08.494515 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e8733e35-ed19-4264-8824-93ebee746e06 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:08.495437 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e8733e35-ed19-4264-8824-93ebee746e06 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:08.495437 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e8733e35-ed19-4264-8824-93ebee746e06 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:08.496113 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e8733e35-ed19-4264-8824-93ebee746e06 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:08.496559 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e8733e35-ed19-4264-8824-93ebee746e06 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:08.497007 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e8733e35-ed19-4264-8824-93ebee746e06 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:08.629176 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e8733e35-ed19-4264-8824-93ebee746e06 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:08.637352 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-e8733e35-ed19-4264-8824-93ebee746e06 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 200 len: 1503 microversion: 2.1 time: 0.154053 Aug 24 07:57:08.637910 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 98/199] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:08 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:09.007826 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-8e225269-78f2-4ee9-bbcd-932eb1e3c27f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:09.011551 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-8e225269-78f2-4ee9-bbcd-932eb1e3c27f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:09.011551 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:09.016520 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8e225269-78f2-4ee9-bbcd-932eb1e3c27f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:09.017187 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8e225269-78f2-4ee9-bbcd-932eb1e3c27f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:09.017700 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8e225269-78f2-4ee9-bbcd-932eb1e3c27f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:09.018409 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8e225269-78f2-4ee9-bbcd-932eb1e3c27f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:09.018860 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8e225269-78f2-4ee9-bbcd-932eb1e3c27f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:09.019284 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8e225269-78f2-4ee9-bbcd-932eb1e3c27f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:09.171658 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-8e225269-78f2-4ee9-bbcd-932eb1e3c27f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:09.180469 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-8e225269-78f2-4ee9-bbcd-932eb1e3c27f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1501 microversion: 2.1 time: 0.176618 Aug 24 07:57:09.185189 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 102/200] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:09 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1501 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:09.200931 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-11f856aa-b8bf-45d0-bf12-da4a0dd30400 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:09.202084 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-11f856aa-b8bf-45d0-bf12-da4a0dd30400 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:09.224830 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-11f856aa-b8bf-45d0-bf12-da4a0dd30400 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:09.224830 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-11f856aa-b8bf-45d0-bf12-da4a0dd30400 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:09.224830 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-11f856aa-b8bf-45d0-bf12-da4a0dd30400 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:09.224830 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-11f856aa-b8bf-45d0-bf12-da4a0dd30400 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:09.225155 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-11f856aa-b8bf-45d0-bf12-da4a0dd30400 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:09.225155 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-11f856aa-b8bf-45d0-bf12-da4a0dd30400 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:09.371241 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-11f856aa-b8bf-45d0-bf12-da4a0dd30400 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:09.380892 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-11f856aa-b8bf-45d0-bf12-da4a0dd30400 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 200 len: 1515 microversion: 2.1 time: 0.183737 Aug 24 07:57:09.382022 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 99/201] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:09 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:09.658569 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-a6307678-b6f3-4ecb-9b8e-f32caa51e33a tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:09.659404 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-a6307678-b6f3-4ecb-9b8e-f32caa51e33a tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:09.667611 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a6307678-b6f3-4ecb-9b8e-f32caa51e33a tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:09.668095 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a6307678-b6f3-4ecb-9b8e-f32caa51e33a tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:09.668524 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a6307678-b6f3-4ecb-9b8e-f32caa51e33a tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:09.669274 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a6307678-b6f3-4ecb-9b8e-f32caa51e33a tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:09.669712 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a6307678-b6f3-4ecb-9b8e-f32caa51e33a tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:09.670124 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a6307678-b6f3-4ecb-9b8e-f32caa51e33a tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:09.889689 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-a6307678-b6f3-4ecb-9b8e-f32caa51e33a tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:09.897336 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-a6307678-b6f3-4ecb-9b8e-f32caa51e33a tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 200 len: 1503 microversion: 2.1 time: 0.243003 Aug 24 07:57:09.899736 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 103/202] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:09 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 1503 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:10.918086 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-a881bfd0-fc8a-4349-b6f4-44367b5610c9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:10.922342 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-a881bfd0-fc8a-4349-b6f4-44367b5610c9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:10.922342 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=62 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:10.925976 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a881bfd0-fc8a-4349-b6f4-44367b5610c9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:10.926451 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a881bfd0-fc8a-4349-b6f4-44367b5610c9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:10.926881 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a881bfd0-fc8a-4349-b6f4-44367b5610c9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:10.927563 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a881bfd0-fc8a-4349-b6f4-44367b5610c9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:10.928008 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a881bfd0-fc8a-4349-b6f4-44367b5610c9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:10.928424 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a881bfd0-fc8a-4349-b6f4-44367b5610c9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:11.058260 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a881bfd0-fc8a-4349-b6f4-44367b5610c9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:11.066024 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-a881bfd0-fc8a-4349-b6f4-44367b5610c9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 200 len: 1503 microversion: 2.1 time: 0.151753 Aug 24 07:57:11.066595 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 100/203] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:10 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:12.087034 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-1c2859bd-e813-48ac-b1fb-75d786e72d7e tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:12.087645 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-1c2859bd-e813-48ac-b1fb-75d786e72d7e tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:12.093803 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1c2859bd-e813-48ac-b1fb-75d786e72d7e tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:12.094348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1c2859bd-e813-48ac-b1fb-75d786e72d7e tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:12.094690 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1c2859bd-e813-48ac-b1fb-75d786e72d7e tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:12.095375 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1c2859bd-e813-48ac-b1fb-75d786e72d7e tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:12.095821 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1c2859bd-e813-48ac-b1fb-75d786e72d7e tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:12.096233 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1c2859bd-e813-48ac-b1fb-75d786e72d7e tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:12.225772 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-1c2859bd-e813-48ac-b1fb-75d786e72d7e tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:12.229381 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:12.234265 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-1c2859bd-e813-48ac-b1fb-75d786e72d7e tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 200 len: 1503 microversion: 2.1 time: 0.151262 Aug 24 07:57:12.234819 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 104/204] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:12 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:12.587610 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-0ad93fb8-fb94-4601-8ed6-40a26b6046b4 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:12.590561 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-0ad93fb8-fb94-4601-8ed6-40a26b6046b4 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:12.597842 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0ad93fb8-fb94-4601-8ed6-40a26b6046b4 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:12.598332 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0ad93fb8-fb94-4601-8ed6-40a26b6046b4 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:12.598838 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0ad93fb8-fb94-4601-8ed6-40a26b6046b4 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:12.599857 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0ad93fb8-fb94-4601-8ed6-40a26b6046b4 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:12.600514 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0ad93fb8-fb94-4601-8ed6-40a26b6046b4 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:12.600965 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0ad93fb8-fb94-4601-8ed6-40a26b6046b4 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:12.627926 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.objects.instance [None req-0ad93fb8-fb94-4601-8ed6-40a26b6046b4 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lazy-loading 'flavor' on Instance uuid fb0fc412-e048-4edd-9a89-5aaaebb38a42 {{(pid=127589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:57:13.076748 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-0ad93fb8-fb94-4601-8ed6-40a26b6046b4 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "POST /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42/action" status: 200 len: 32 microversion: 2.1 time: 0.495838 Aug 24 07:57:13.077398 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 101/205] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 24 07:57:12 2022] POST /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42/action => generated 32 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 07:57:13.088138 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-7bfb0664-6e5e-4923-8d93-7df59ec04d89 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:13.088821 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-7bfb0664-6e5e-4923-8d93-7df59ec04d89 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:13.095419 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7bfb0664-6e5e-4923-8d93-7df59ec04d89 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:13.096178 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7bfb0664-6e5e-4923-8d93-7df59ec04d89 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:13.096838 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7bfb0664-6e5e-4923-8d93-7df59ec04d89 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:13.097562 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7bfb0664-6e5e-4923-8d93-7df59ec04d89 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:13.098016 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7bfb0664-6e5e-4923-8d93-7df59ec04d89 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:13.098446 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7bfb0664-6e5e-4923-8d93-7df59ec04d89 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:13.258714 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-a4911ca4-9304-42ee-8549-bf7b975f9425 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:13.259015 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-a4911ca4-9304-42ee-8549-bf7b975f9425 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:13.278155 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a4911ca4-9304-42ee-8549-bf7b975f9425 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:13.278942 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a4911ca4-9304-42ee-8549-bf7b975f9425 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:13.280146 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a4911ca4-9304-42ee-8549-bf7b975f9425 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:13.280891 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a4911ca4-9304-42ee-8549-bf7b975f9425 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:13.281596 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a4911ca4-9304-42ee-8549-bf7b975f9425 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:13.282309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a4911ca4-9304-42ee-8549-bf7b975f9425 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:13.355815 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-7bfb0664-6e5e-4923-8d93-7df59ec04d89 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:13.363902 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-7bfb0664-6e5e-4923-8d93-7df59ec04d89 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 200 len: 1521 microversion: 2.1 time: 0.280591 Aug 24 07:57:13.364477 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 105/206] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:13 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:13.494171 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a4911ca4-9304-42ee-8549-bf7b975f9425 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:13.502443 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-a4911ca4-9304-42ee-8549-bf7b975f9425 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 200 len: 1503 microversion: 2.1 time: 0.249842 Aug 24 07:57:13.503294 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 102/207] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:13 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 1503 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:14.386314 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-c20a6358-d7ee-4cfa-b6a2-4749ec58e854 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:14.388762 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-c20a6358-d7ee-4cfa-b6a2-4749ec58e854 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:14.395579 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c20a6358-d7ee-4cfa-b6a2-4749ec58e854 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:14.396273 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c20a6358-d7ee-4cfa-b6a2-4749ec58e854 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:14.396899 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c20a6358-d7ee-4cfa-b6a2-4749ec58e854 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:14.398037 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c20a6358-d7ee-4cfa-b6a2-4749ec58e854 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:14.399298 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c20a6358-d7ee-4cfa-b6a2-4749ec58e854 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:14.400318 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c20a6358-d7ee-4cfa-b6a2-4749ec58e854 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:14.524681 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-3174abc6-2d0e-4e03-b910-38dad39232d9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:14.526302 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-3174abc6-2d0e-4e03-b910-38dad39232d9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:14.545518 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3174abc6-2d0e-4e03-b910-38dad39232d9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:14.547481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3174abc6-2d0e-4e03-b910-38dad39232d9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:14.548080 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3174abc6-2d0e-4e03-b910-38dad39232d9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:14.549028 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3174abc6-2d0e-4e03-b910-38dad39232d9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:14.549627 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3174abc6-2d0e-4e03-b910-38dad39232d9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:14.550214 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3174abc6-2d0e-4e03-b910-38dad39232d9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:14.572078 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-c20a6358-d7ee-4cfa-b6a2-4749ec58e854 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:14.605006 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-c20a6358-d7ee-4cfa-b6a2-4749ec58e854 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 200 len: 1521 microversion: 2.1 time: 0.222273 Aug 24 07:57:14.607609 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 106/208] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:14 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:14.644865 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-3174abc6-2d0e-4e03-b910-38dad39232d9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:14.660965 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-3174abc6-2d0e-4e03-b910-38dad39232d9 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 200 len: 1461 microversion: 2.1 time: 0.136572 Aug 24 07:57:14.660965 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 103/209] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:14 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 1461 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:14.757759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-8f036ec4-7e76-4ab6-8142-d342595b3009 req-372bc156-fd29-4979-b311-eb6f2b81ecfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68ff8b45-89e5-410a-878e-3f13dd4aeb2a", "name": "network-vif-deleted", "tag": "493fabbb-65d6-48e1-b2e1-894acb2f866c"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:14.768111 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-8f036ec4-7e76-4ab6-8142-d342595b3009 req-372bc156-fd29-4979-b311-eb6f2b81ecfe service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:14.768592 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-8f036ec4-7e76-4ab6-8142-d342595b3009 req-372bc156-fd29-4979-b311-eb6f2b81ecfe service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:14.769057 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-8f036ec4-7e76-4ab6-8142-d342595b3009 req-372bc156-fd29-4979-b311-eb6f2b81ecfe service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:14.783853 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-8f036ec4-7e76-4ab6-8142-d342595b3009 req-372bc156-fd29-4979-b311-eb6f2b81ecfe service nova] Creating event network-vif-deleted:493fabbb-65d6-48e1-b2e1-894acb2f866c for instance 68ff8b45-89e5-410a-878e-3f13dd4aeb2a on hv-cinder-85427 Aug 24 07:57:14.790137 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-8f036ec4-7e76-4ab6-8142-d342595b3009 req-372bc156-fd29-4979-b311-eb6f2b81ecfe service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035945 Aug 24 07:57:14.790998 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 107/210] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:57:15.642151 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-03db1410-8c9b-43b8-a5f6-3b42cf04ae95 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:15.642763 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-03db1410-8c9b-43b8-a5f6-3b42cf04ae95 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:15.649175 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-03db1410-8c9b-43b8-a5f6-3b42cf04ae95 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:15.649685 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-03db1410-8c9b-43b8-a5f6-3b42cf04ae95 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:15.650127 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-03db1410-8c9b-43b8-a5f6-3b42cf04ae95 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:15.650818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-03db1410-8c9b-43b8-a5f6-3b42cf04ae95 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:15.651272 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-03db1410-8c9b-43b8-a5f6-3b42cf04ae95 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:15.651696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-03db1410-8c9b-43b8-a5f6-3b42cf04ae95 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:15.667393 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:15.679610 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-37fbc61d-00cd-445f-a507-b087a73a97f8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:15.681114 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-37fbc61d-00cd-445f-a507-b087a73a97f8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:15.687557 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-37fbc61d-00cd-445f-a507-b087a73a97f8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:15.688046 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-37fbc61d-00cd-445f-a507-b087a73a97f8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:15.688484 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-37fbc61d-00cd-445f-a507-b087a73a97f8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:15.689254 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-37fbc61d-00cd-445f-a507-b087a73a97f8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:15.689705 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-37fbc61d-00cd-445f-a507-b087a73a97f8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:15.690128 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-37fbc61d-00cd-445f-a507-b087a73a97f8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:15.722352 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-37fbc61d-00cd-445f-a507-b087a73a97f8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:15.722726 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-37fbc61d-00cd-445f-a507-b087a73a97f8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:15.723158 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-37fbc61d-00cd-445f-a507-b087a73a97f8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:15.723659 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.objects.instance [None req-37fbc61d-00cd-445f-a507-b087a73a97f8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lazy-loading 'fault' on Instance uuid 68ff8b45-89e5-410a-878e-3f13dd4aeb2a {{(pid=127590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:57:15.785665 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-37fbc61d-00cd-445f-a507-b087a73a97f8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:15.794891 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-37fbc61d-00cd-445f-a507-b087a73a97f8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 200 len: 1303 microversion: 2.1 time: 0.119424 Aug 24 07:57:15.798071 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 108/211] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:15 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 1303 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:15.811190 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-03db1410-8c9b-43b8-a5f6-3b42cf04ae95 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:15.819210 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-03db1410-8c9b-43b8-a5f6-3b42cf04ae95 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 200 len: 1521 microversion: 2.1 time: 0.180868 Aug 24 07:57:15.821005 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 104/212] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:15 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:16.817929 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-a4273d00-335f-4197-983e-6aef4e8b3c99 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:16.818569 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-a4273d00-335f-4197-983e-6aef4e8b3c99 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 68ff8b45-89e5-410a-878e-3f13dd4aeb2a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:16.825220 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a4273d00-335f-4197-983e-6aef4e8b3c99 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:16.825700 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a4273d00-335f-4197-983e-6aef4e8b3c99 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:16.826130 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a4273d00-335f-4197-983e-6aef4e8b3c99 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:16.826813 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a4273d00-335f-4197-983e-6aef4e8b3c99 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:16.827263 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a4273d00-335f-4197-983e-6aef4e8b3c99 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:16.827684 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a4273d00-335f-4197-983e-6aef4e8b3c99 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:16.841012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-f9e60111-9762-44f0-a85c-7dae2cb9aaae tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:16.841624 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-f9e60111-9762-44f0-a85c-7dae2cb9aaae tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:16.841751 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.wsgi [None req-a4273d00-335f-4197-983e-6aef4e8b3c99 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] HTTP exception thrown: Instance 68ff8b45-89e5-410a-878e-3f13dd4aeb2a could not be found. Aug 24 07:57:16.843348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-a4273d00-335f-4197-983e-6aef4e8b3c99 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Request method failure captured: Aug 24 07:57:16.843348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: request: GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a HTTP/1.1 Aug 24 07:57:16.843348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept: application/json Aug 24 07:57:16.843348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept-Encoding: identity Aug 24 07:57:16.843348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Connection: close Aug 24 07:57:16.843348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Length: 0 Aug 24 07:57:16.843348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Type: application/json Aug 24 07:57:16.843348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Host: 10.222.0.72 Aug 24 07:57:16.843348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Openstack-System-Scope: None Aug 24 07:57:16.843348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: User-Agent: python-urllib3/1.26.11 Aug 24 07:57:16.843348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Auth-Token: gAAAAABjBdmy0pNjy140VpPbw3T3MSe-eEJp7i800zHWXCfzOfe86TFq1QN-ZAvxixaNwC77wEXyJPfn3BWsP3_z1dSFIC03espJG7uxGr0H9FdvdGo4svOo95xTvn4welPepCiJc6qHKl2JDfeWkJMLTUFwr67WvN2-7oITFiWtv6snP2-iX4k Aug 24 07:57:16.843348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Id: None Aug 24 07:57:16.843348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Name: None Aug 24 07:57:16.843348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Identity-Status: Confirmed Aug 24 07:57:16.843348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Is-Admin-Project: True Aug 24 07:57:16.843348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Id: default Aug 24 07:57:16.843348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Name: Default Aug 24 07:57:16.843348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Id: 647a6443ec0c49e58d3cdb373d681c38 Aug 24 07:57:16.843348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Name: tempest-VolumesActionsTest-1050177248 Aug 24 07:57:16.843348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Role: reader,member Aug 24 07:57:16.843348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Roles: reader,member Aug 24 07:57:16.844842 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_647a6443ec0c49e58d3cdb373d681c38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/647a6443ec0c49e58d3cdb373d681c38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/647a6443ec0c49e58d3cdb373d681c38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/647a6443ec0c49e58d3cdb373d681c38"}]}] Aug 24 07:57:16.844842 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant: tempest-VolumesActionsTest-1050177248 Aug 24 07:57:16.844842 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Id: 647a6443ec0c49e58d3cdb373d681c38 Aug 24 07:57:16.844842 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Name: tempest-VolumesActionsTest-1050177248 Aug 24 07:57:16.844842 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User: tempest-VolumesActionsTest-1050177248-project Aug 24 07:57:16.844842 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Id: default Aug 24 07:57:16.844842 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Name: Default Aug 24 07:57:16.844842 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Id: ed5bde75f6d2477ab2747016ab5c309e Aug 24 07:57:16.844842 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Name: tempest-VolumesActionsTest-1050177248-project Aug 24 07:57:16.844842 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: method: > Aug 24 07:57:16.844842 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: exception: Instance 68ff8b45-89e5-410a-878e-3f13dd4aeb2a could not be found. Aug 24 07:57:16.844842 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: action_args: {'id': '68ff8b45-89e5-410a-878e-3f13dd4aeb2a'} Aug 24 07:57:16.845693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:57:16.845693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:57:16.845693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:57:16.845693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:57:16.845693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:57:16.845693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:57:16.845693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:57:16.845693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:57:16.845693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:57:16.845693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:57:16.845693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68ff8b45-89e5-410a-878e-3f13dd4aeb2a could not be found. Aug 24 07:57:16.845693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:57:16.845693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:57:16.845693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:57:16.845693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:57:16.845693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:57:16.845693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:57:16.845693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:57:16.845693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:57:16.845693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:57:16.847101 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:57:16.847101 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:57:16.847101 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:57:16.847101 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:57:16.847101 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:57:16.847101 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:57:16.847101 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:57:16.847101 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68ff8b45-89e5-410a-878e-3f13dd4aeb2a could not be found. Aug 24 07:57:16.847101 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:57:16.847101 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:57:16.847101 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:57:16.847101 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:57:16.847101 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:57:16.847101 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:57:16.847101 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:57:16.847101 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:57:16.847101 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68ff8b45-89e5-410a-878e-3f13dd4aeb2a could not be found. Aug 24 07:57:16.847101 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:57:16.848453 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-a4273d00-335f-4197-983e-6aef4e8b3c99 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Returning 404 to user: Instance 68ff8b45-89e5-410a-878e-3f13dd4aeb2a could not be found. {{(pid=127590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:57:16.848453 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-a4273d00-335f-4197-983e-6aef4e8b3c99 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a" status: 404 len: 111 microversion: 2.1 time: 0.030935 Aug 24 07:57:16.848453 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 109/213] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:16 2022] GET /compute/v2.1/servers/68ff8b45-89e5-410a-878e-3f13dd4aeb2a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:57:16.852309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f9e60111-9762-44f0-a85c-7dae2cb9aaae tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:16.852309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f9e60111-9762-44f0-a85c-7dae2cb9aaae tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:16.852309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f9e60111-9762-44f0-a85c-7dae2cb9aaae tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:16.852309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f9e60111-9762-44f0-a85c-7dae2cb9aaae tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:16.860122 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f9e60111-9762-44f0-a85c-7dae2cb9aaae tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:16.860122 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f9e60111-9762-44f0-a85c-7dae2cb9aaae tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:16.961738 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-e50e0fe7-6c75-45c4-aace-49eb19e6e95c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-860832436", "imageRef": "ccdab334-55ce-4ff5-bd97-5a424660c282", "flavorRef": "452", "networks": [{"uuid": "3a6228c9-5ae1-4d34-9726-5ba5af8c41d6"}]}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:16.997977 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-f9e60111-9762-44f0-a85c-7dae2cb9aaae tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:17.007696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-f9e60111-9762-44f0-a85c-7dae2cb9aaae tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 200 len: 1521 microversion: 2.1 time: 0.170977 Aug 24 07:57:17.021050 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 105/214] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:16 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:17.022743 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.network.neutron [None req-e50e0fe7-6c75-45c4-aace-49eb19e6e95c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] validate_networks() for [('3a6228c9-5ae1-4d34-9726-5ba5af8c41d6', None, None, None, None, None)] {{(pid=127590) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:57:17.423789 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-e50e0fe7-6c75-45c4-aace-49eb19e6e95c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Flavor limits 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:57:17.424220 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-e50e0fe7-6c75-45c4-aace-49eb19e6e95c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Image limits 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:57:17.424723 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-e50e0fe7-6c75-45c4-aace-49eb19e6e95c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Flavor pref 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:57:17.425157 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-e50e0fe7-6c75-45c4-aace-49eb19e6e95c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Image pref 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:57:17.425567 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-e50e0fe7-6c75-45c4-aace-49eb19e6e95c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:57:17.434757 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e50e0fe7-6c75-45c4-aace-49eb19e6e95c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:17.435232 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e50e0fe7-6c75-45c4-aace-49eb19e6e95c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:17.435654 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e50e0fe7-6c75-45c4-aace-49eb19e6e95c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:17.436382 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e50e0fe7-6c75-45c4-aace-49eb19e6e95c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:17.436860 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e50e0fe7-6c75-45c4-aace-49eb19e6e95c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:17.437285 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e50e0fe7-6c75-45c4-aace-49eb19e6e95c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:17.454785 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-e50e0fe7-6c75-45c4-aace-49eb19e6e95c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Getting quotas for project 647a6443ec0c49e58d3cdb373d681c38. Resources: {'cores', 'instances', 'ram'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:57:17.458751 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-e50e0fe7-6c75-45c4-aace-49eb19e6e95c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Getting quotas for user ed5bde75f6d2477ab2747016ab5c309e and project 647a6443ec0c49e58d3cdb373d681c38. Resources: {'cores', 'instances', 'ram'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:57:17.470557 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-e50e0fe7-6c75-45c4-aace-49eb19e6e95c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Going to run 1 instances... {{(pid=127590) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:57:17.472904 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-e50e0fe7-6c75-45c4-aace-49eb19e6e95c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccdab334-55ce-4ff5-bd97-5a424660c282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:57:17.605744 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-e50e0fe7-6c75-45c4-aace-49eb19e6e95c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649369 Aug 24 07:57:17.606755 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 110/215] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 24 07:57:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:57:17.617779 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-2b02e7fb-3225-48d5-a6a6-f4eb4bcda87b tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:17.618481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-2b02e7fb-3225-48d5-a6a6-f4eb4bcda87b tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:17.671812 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-2b02e7fb-3225-48d5-a6a6-f4eb4bcda87b tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:17.678811 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-2b02e7fb-3225-48d5-a6a6-f4eb4bcda87b tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1213 microversion: 2.1 time: 0.064838 Aug 24 07:57:17.679377 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 106/216] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:17 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:18.034846 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-9e489da1-cfac-41c3-8b7e-d2dd12d7f12b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:18.034846 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-9e489da1-cfac-41c3-8b7e-d2dd12d7f12b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:18.041715 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e489da1-cfac-41c3-8b7e-d2dd12d7f12b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:18.042283 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e489da1-cfac-41c3-8b7e-d2dd12d7f12b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:18.042795 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e489da1-cfac-41c3-8b7e-d2dd12d7f12b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:18.043577 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e489da1-cfac-41c3-8b7e-d2dd12d7f12b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:18.044136 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e489da1-cfac-41c3-8b7e-d2dd12d7f12b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:18.044632 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e489da1-cfac-41c3-8b7e-d2dd12d7f12b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:18.203532 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9e489da1-cfac-41c3-8b7e-d2dd12d7f12b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:18.212578 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-9e489da1-cfac-41c3-8b7e-d2dd12d7f12b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 200 len: 1521 microversion: 2.1 time: 0.182899 Aug 24 07:57:18.213396 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 111/217] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:18 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:18.700039 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-689a82cb-ff45-4498-ab70-759c0471f172 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:18.700670 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-689a82cb-ff45-4498-ab70-759c0471f172 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:18.707035 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-689a82cb-ff45-4498-ab70-759c0471f172 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:18.707513 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-689a82cb-ff45-4498-ab70-759c0471f172 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:18.707960 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-689a82cb-ff45-4498-ab70-759c0471f172 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:18.708637 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-689a82cb-ff45-4498-ab70-759c0471f172 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:18.709118 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-689a82cb-ff45-4498-ab70-759c0471f172 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:18.709529 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-689a82cb-ff45-4498-ab70-759c0471f172 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:18.779560 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-689a82cb-ff45-4498-ab70-759c0471f172 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:18.787938 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-689a82cb-ff45-4498-ab70-759c0471f172 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1217 microversion: 2.1 time: 0.092105 Aug 24 07:57:18.788527 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 107/218] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:18 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:19.233745 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-d87181ef-d950-4e68-94db-81b176751d2a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:19.234541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-d87181ef-d950-4e68-94db-81b176751d2a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:19.241157 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d87181ef-d950-4e68-94db-81b176751d2a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:19.241645 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d87181ef-d950-4e68-94db-81b176751d2a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:19.242082 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d87181ef-d950-4e68-94db-81b176751d2a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:19.243349 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d87181ef-d950-4e68-94db-81b176751d2a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:19.243800 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d87181ef-d950-4e68-94db-81b176751d2a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:19.248156 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d87181ef-d950-4e68-94db-81b176751d2a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:19.381595 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-d87181ef-d950-4e68-94db-81b176751d2a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:19.398356 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-d87181ef-d950-4e68-94db-81b176751d2a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 200 len: 1521 microversion: 2.1 time: 0.168193 Aug 24 07:57:19.399317 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 112/219] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:19 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:19.810595 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b5c4c7a5-17f5-41ed-be2d-929ba5080f55 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:19.811216 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-b5c4c7a5-17f5-41ed-be2d-929ba5080f55 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:19.817469 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b5c4c7a5-17f5-41ed-be2d-929ba5080f55 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:19.818235 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b5c4c7a5-17f5-41ed-be2d-929ba5080f55 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:19.818922 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b5c4c7a5-17f5-41ed-be2d-929ba5080f55 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:19.819887 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b5c4c7a5-17f5-41ed-be2d-929ba5080f55 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:19.820703 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b5c4c7a5-17f5-41ed-be2d-929ba5080f55 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:19.821361 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b5c4c7a5-17f5-41ed-be2d-929ba5080f55 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:19.899857 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b5c4c7a5-17f5-41ed-be2d-929ba5080f55 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:19.907865 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-b5c4c7a5-17f5-41ed-be2d-929ba5080f55 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1265 microversion: 2.1 time: 0.101463 Aug 24 07:57:19.912708 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 108/220] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:19 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1265 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:20.419823 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-8b0c29ca-b94e-4d80-9cf2-9ccea42217ce tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:20.420430 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-8b0c29ca-b94e-4d80-9cf2-9ccea42217ce tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:20.426885 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8b0c29ca-b94e-4d80-9cf2-9ccea42217ce tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:20.427603 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8b0c29ca-b94e-4d80-9cf2-9ccea42217ce tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:20.428240 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8b0c29ca-b94e-4d80-9cf2-9ccea42217ce tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:20.429402 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8b0c29ca-b94e-4d80-9cf2-9ccea42217ce tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:20.433449 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8b0c29ca-b94e-4d80-9cf2-9ccea42217ce tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:20.433449 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8b0c29ca-b94e-4d80-9cf2-9ccea42217ce tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:20.678869 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-8b0c29ca-b94e-4d80-9cf2-9ccea42217ce tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:20.689869 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-8b0c29ca-b94e-4d80-9cf2-9ccea42217ce tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 200 len: 1521 microversion: 2.1 time: 0.273791 Aug 24 07:57:20.697828 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 113/221] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:20 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:20.929772 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-7d01c422-3ba2-4c82-a09a-d9c6b2f6fc04 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:20.930974 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-7d01c422-3ba2-4c82-a09a-d9c6b2f6fc04 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:20.937474 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7d01c422-3ba2-4c82-a09a-d9c6b2f6fc04 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:20.937951 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7d01c422-3ba2-4c82-a09a-d9c6b2f6fc04 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:20.938376 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7d01c422-3ba2-4c82-a09a-d9c6b2f6fc04 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:20.939144 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7d01c422-3ba2-4c82-a09a-d9c6b2f6fc04 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:20.939598 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7d01c422-3ba2-4c82-a09a-d9c6b2f6fc04 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:20.940051 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7d01c422-3ba2-4c82-a09a-d9c6b2f6fc04 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:21.208997 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7d01c422-3ba2-4c82-a09a-d9c6b2f6fc04 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:21.217566 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-7d01c422-3ba2-4c82-a09a-d9c6b2f6fc04 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1313 microversion: 2.1 time: 0.291659 Aug 24 07:57:21.218159 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 109/222] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:20 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:21.715152 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-701ae3e1-9926-4fc7-ac2d-78838a1b3604 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:21.715757 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-701ae3e1-9926-4fc7-ac2d-78838a1b3604 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:21.722831 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-701ae3e1-9926-4fc7-ac2d-78838a1b3604 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:21.723321 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-701ae3e1-9926-4fc7-ac2d-78838a1b3604 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:21.724054 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-701ae3e1-9926-4fc7-ac2d-78838a1b3604 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:21.724799 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-701ae3e1-9926-4fc7-ac2d-78838a1b3604 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:21.725266 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-701ae3e1-9926-4fc7-ac2d-78838a1b3604 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:21.725684 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-701ae3e1-9926-4fc7-ac2d-78838a1b3604 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:21.873300 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-701ae3e1-9926-4fc7-ac2d-78838a1b3604 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:21.886811 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-701ae3e1-9926-4fc7-ac2d-78838a1b3604 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 200 len: 1521 microversion: 2.1 time: 0.175711 Aug 24 07:57:21.887990 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 114/223] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:21 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:22.201410 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-e23918eb-4ea1-4a35-bdba-8053e80824f5 req-16ac4a18-7a03-48a0-8c58-6dcb7a9a00e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3", "tag": "a63a1dfa-d3cb-4860-961a-7e951b10e39b"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:22.212467 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-e23918eb-4ea1-4a35-bdba-8053e80824f5 req-16ac4a18-7a03-48a0-8c58-6dcb7a9a00e7 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:22.213351 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-e23918eb-4ea1-4a35-bdba-8053e80824f5 req-16ac4a18-7a03-48a0-8c58-6dcb7a9a00e7 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:22.213464 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-e23918eb-4ea1-4a35-bdba-8053e80824f5 req-16ac4a18-7a03-48a0-8c58-6dcb7a9a00e7 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:22.225814 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-e23918eb-4ea1-4a35-bdba-8053e80824f5 req-16ac4a18-7a03-48a0-8c58-6dcb7a9a00e7 service nova] Creating event network-changed:a63a1dfa-d3cb-4860-961a-7e951b10e39b for instance 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 on hv-cinder-85427 Aug 24 07:57:22.231887 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-e23918eb-4ea1-4a35-bdba-8053e80824f5 req-16ac4a18-7a03-48a0-8c58-6dcb7a9a00e7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034796 Aug 24 07:57:22.233607 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 110/224] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:57:22.238717 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-14376dde-547f-45d6-ad48-a961775c2083 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:22.239326 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-14376dde-547f-45d6-ad48-a961775c2083 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:22.246955 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-14376dde-547f-45d6-ad48-a961775c2083 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:22.248847 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-14376dde-547f-45d6-ad48-a961775c2083 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:22.248847 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-14376dde-547f-45d6-ad48-a961775c2083 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:22.248847 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-14376dde-547f-45d6-ad48-a961775c2083 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:22.249105 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-14376dde-547f-45d6-ad48-a961775c2083 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:22.249425 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-14376dde-547f-45d6-ad48-a961775c2083 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:22.534606 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-14376dde-547f-45d6-ad48-a961775c2083 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:22.544778 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-14376dde-547f-45d6-ad48-a961775c2083 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1313 microversion: 2.1 time: 0.309778 Aug 24 07:57:22.546065 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 115/225] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:22 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:22.908225 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e073550e-c62e-4b1b-9c6f-c1895c48ae23 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:22.909634 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-e073550e-c62e-4b1b-9c6f-c1895c48ae23 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:22.918734 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e073550e-c62e-4b1b-9c6f-c1895c48ae23 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:22.919604 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e073550e-c62e-4b1b-9c6f-c1895c48ae23 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:22.919955 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e073550e-c62e-4b1b-9c6f-c1895c48ae23 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:22.920869 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e073550e-c62e-4b1b-9c6f-c1895c48ae23 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:22.921320 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e073550e-c62e-4b1b-9c6f-c1895c48ae23 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:22.921897 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e073550e-c62e-4b1b-9c6f-c1895c48ae23 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:23.090118 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e073550e-c62e-4b1b-9c6f-c1895c48ae23 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:23.100478 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-e073550e-c62e-4b1b-9c6f-c1895c48ae23 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 200 len: 1521 microversion: 2.1 time: 0.196675 Aug 24 07:57:23.101554 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 111/226] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:22 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:23.566770 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-2bd3b75a-fce5-4a5d-8254-a9cfc709e3e5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:23.567427 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-2bd3b75a-fce5-4a5d-8254-a9cfc709e3e5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:23.574354 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2bd3b75a-fce5-4a5d-8254-a9cfc709e3e5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:23.575069 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2bd3b75a-fce5-4a5d-8254-a9cfc709e3e5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:23.575700 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2bd3b75a-fce5-4a5d-8254-a9cfc709e3e5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:23.576639 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2bd3b75a-fce5-4a5d-8254-a9cfc709e3e5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:23.577251 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2bd3b75a-fce5-4a5d-8254-a9cfc709e3e5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:23.577815 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2bd3b75a-fce5-4a5d-8254-a9cfc709e3e5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:23.751772 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-2bd3b75a-fce5-4a5d-8254-a9cfc709e3e5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:23.760151 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-2bd3b75a-fce5-4a5d-8254-a9cfc709e3e5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1313 microversion: 2.1 time: 0.197223 Aug 24 07:57:23.765017 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 116/227] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:23 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:24.120501 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-68ff34e4-0721-40de-8776-6df76f29a5e2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:24.121119 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-68ff34e4-0721-40de-8776-6df76f29a5e2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:24.127522 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-68ff34e4-0721-40de-8776-6df76f29a5e2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:24.128245 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-68ff34e4-0721-40de-8776-6df76f29a5e2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:24.128701 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-68ff34e4-0721-40de-8776-6df76f29a5e2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:24.130053 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-68ff34e4-0721-40de-8776-6df76f29a5e2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:24.131270 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-68ff34e4-0721-40de-8776-6df76f29a5e2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:24.131694 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-68ff34e4-0721-40de-8776-6df76f29a5e2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:24.261754 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-68ff34e4-0721-40de-8776-6df76f29a5e2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:24.270135 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-68ff34e4-0721-40de-8776-6df76f29a5e2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 200 len: 1521 microversion: 2.1 time: 0.153381 Aug 24 07:57:24.270746 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 112/228] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:24 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:24.781410 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-9ee1cd5f-4ed1-495e-bc40-a07c5cdfe274 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:24.782013 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-9ee1cd5f-4ed1-495e-bc40-a07c5cdfe274 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:24.788371 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9ee1cd5f-4ed1-495e-bc40-a07c5cdfe274 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:24.789403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9ee1cd5f-4ed1-495e-bc40-a07c5cdfe274 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:24.789838 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9ee1cd5f-4ed1-495e-bc40-a07c5cdfe274 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:24.790531 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9ee1cd5f-4ed1-495e-bc40-a07c5cdfe274 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:24.790979 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9ee1cd5f-4ed1-495e-bc40-a07c5cdfe274 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:24.791391 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9ee1cd5f-4ed1-495e-bc40-a07c5cdfe274 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:24.968573 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9ee1cd5f-4ed1-495e-bc40-a07c5cdfe274 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:24.977015 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-9ee1cd5f-4ed1-495e-bc40-a07c5cdfe274 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1313 microversion: 2.1 time: 0.198769 Aug 24 07:57:24.977916 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 117/229] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:24 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:25.291511 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-423a2786-4cc7-4636-a62c-d534ac77e030 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:25.292353 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-423a2786-4cc7-4636-a62c-d534ac77e030 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:25.298973 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-423a2786-4cc7-4636-a62c-d534ac77e030 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:25.299589 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-423a2786-4cc7-4636-a62c-d534ac77e030 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:25.300031 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-423a2786-4cc7-4636-a62c-d534ac77e030 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:25.300776 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-423a2786-4cc7-4636-a62c-d534ac77e030 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:25.301237 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-423a2786-4cc7-4636-a62c-d534ac77e030 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:25.301666 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-423a2786-4cc7-4636-a62c-d534ac77e030 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:25.396011 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-103e5937-590b-4983-b5c7-dcbc7e4d39e6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:25.396695 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-103e5937-590b-4983-b5c7-dcbc7e4d39e6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:25.407043 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-103e5937-590b-4983-b5c7-dcbc7e4d39e6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:25.413152 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-103e5937-590b-4983-b5c7-dcbc7e4d39e6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:25.414557 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-103e5937-590b-4983-b5c7-dcbc7e4d39e6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:25.418267 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-103e5937-590b-4983-b5c7-dcbc7e4d39e6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:25.418968 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-103e5937-590b-4983-b5c7-dcbc7e4d39e6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:25.419525 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-103e5937-590b-4983-b5c7-dcbc7e4d39e6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:25.511733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-423a2786-4cc7-4636-a62c-d534ac77e030 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:25.520791 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-423a2786-4cc7-4636-a62c-d534ac77e030 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 200 len: 1521 microversion: 2.1 time: 0.233064 Aug 24 07:57:25.521383 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 113/230] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:25 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:25.599782 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-103e5937-590b-4983-b5c7-dcbc7e4d39e6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711/ips" status: 200 len: 151 microversion: 2.20 time: 0.208378 Aug 24 07:57:25.600376 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 118/231] 10.222.0.72 () {60 vars in 1289 bytes} [Wed Aug 24 07:57:25 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711/ips => generated 151 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 07:57:25.996913 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e4bec13a-6b85-492a-aaad-976f805f891b tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:25.997536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-e4bec13a-6b85-492a-aaad-976f805f891b tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:26.003549 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e4bec13a-6b85-492a-aaad-976f805f891b tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:26.008048 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e4bec13a-6b85-492a-aaad-976f805f891b tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:26.008048 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e4bec13a-6b85-492a-aaad-976f805f891b tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:26.008048 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e4bec13a-6b85-492a-aaad-976f805f891b tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:26.008048 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e4bec13a-6b85-492a-aaad-976f805f891b tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:26.008779 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e4bec13a-6b85-492a-aaad-976f805f891b tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:26.142984 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e4bec13a-6b85-492a-aaad-976f805f891b tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:26.151505 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-e4bec13a-6b85-492a-aaad-976f805f891b tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1313 microversion: 2.1 time: 0.158411 Aug 24 07:57:26.152088 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 114/232] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:25 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:26.543599 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-8f351c9c-58f8-418d-8377-4596b958b511 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:26.545024 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-8f351c9c-58f8-418d-8377-4596b958b511 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:26.551112 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8f351c9c-58f8-418d-8377-4596b958b511 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:26.551602 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8f351c9c-58f8-418d-8377-4596b958b511 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:26.552030 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8f351c9c-58f8-418d-8377-4596b958b511 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:26.552925 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8f351c9c-58f8-418d-8377-4596b958b511 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:26.553528 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8f351c9c-58f8-418d-8377-4596b958b511 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:26.554145 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8f351c9c-58f8-418d-8377-4596b958b511 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:26.700612 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-8f351c9c-58f8-418d-8377-4596b958b511 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:26.710958 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-8f351c9c-58f8-418d-8377-4596b958b511 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 200 len: 1521 microversion: 2.1 time: 0.171096 Aug 24 07:57:26.712046 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 119/233] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:26 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:27.173044 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b06f7666-fc24-478e-879b-5bbb3f9a7868 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:27.173594 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-b06f7666-fc24-478e-879b-5bbb3f9a7868 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:27.180067 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b06f7666-fc24-478e-879b-5bbb3f9a7868 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:27.180548 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b06f7666-fc24-478e-879b-5bbb3f9a7868 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:27.181017 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b06f7666-fc24-478e-879b-5bbb3f9a7868 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:27.181702 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b06f7666-fc24-478e-879b-5bbb3f9a7868 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:27.182153 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b06f7666-fc24-478e-879b-5bbb3f9a7868 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:27.182572 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b06f7666-fc24-478e-879b-5bbb3f9a7868 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:27.311779 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b06f7666-fc24-478e-879b-5bbb3f9a7868 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:27.319550 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-b06f7666-fc24-478e-879b-5bbb3f9a7868 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1313 microversion: 2.1 time: 0.150449 Aug 24 07:57:27.321498 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 115/234] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:27 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:27.735866 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-7444ec7e-5fc3-4acb-ae2f-d19af67a8205 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:27.736536 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-7444ec7e-5fc3-4acb-ae2f-d19af67a8205 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:27.741593 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=2 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:27.742778 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=6 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:27.747959 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7444ec7e-5fc3-4acb-ae2f-d19af67a8205 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:27.748463 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7444ec7e-5fc3-4acb-ae2f-d19af67a8205 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:27.748926 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7444ec7e-5fc3-4acb-ae2f-d19af67a8205 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:27.749638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7444ec7e-5fc3-4acb-ae2f-d19af67a8205 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:27.750083 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7444ec7e-5fc3-4acb-ae2f-d19af67a8205 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:27.750714 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7444ec7e-5fc3-4acb-ae2f-d19af67a8205 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:27.902650 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-7444ec7e-5fc3-4acb-ae2f-d19af67a8205 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:27.914681 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-7444ec7e-5fc3-4acb-ae2f-d19af67a8205 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 200 len: 1501 microversion: 2.1 time: 0.182444 Aug 24 07:57:27.924289 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 120/235] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:27 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 1501 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:27.952522 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b1a66008-3405-49e9-a3b5-bdd90b2ef0d5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30e6b980-35a9-4a69-81f9-51ee7c9d9a0b"}} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:27.955321 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-b1a66008-3405-49e9-a3b5-bdd90b2ef0d5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:27.963317 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=2 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:27.965038 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b1a66008-3405-49e9-a3b5-bdd90b2ef0d5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:27.965994 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b1a66008-3405-49e9-a3b5-bdd90b2ef0d5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:27.966644 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b1a66008-3405-49e9-a3b5-bdd90b2ef0d5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:27.968286 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b1a66008-3405-49e9-a3b5-bdd90b2ef0d5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:27.968995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b1a66008-3405-49e9-a3b5-bdd90b2ef0d5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:27.969575 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b1a66008-3405-49e9-a3b5-bdd90b2ef0d5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:27.999467 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-b1a66008-3405-49e9-a3b5-bdd90b2ef0d5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] HTTP exception thrown: Cannot 'attach_volume' instance fb0fc412-e048-4edd-9a89-5aaaebb38a42 while it is in vm_state rescued Aug 24 07:57:28.004184 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b1a66008-3405-49e9-a3b5-bdd90b2ef0d5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Request method failure captured: Aug 24 07:57:28.004184 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: POST /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42/os-volume_attachments HTTP/1.1 Aug 24 07:57:28.004184 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 07:57:28.004184 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 07:57:28.004184 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 07:57:28.004184 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 74 Aug 24 07:57:28.004184 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 07:57:28.004184 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 07:57:28.004184 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 07:57:28.004184 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 07:57:28.004184 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdl77mMuddCdCHjWrd8DH39AXHJIXv_-vLiyIketMjF1z0b7hh5tClcXlKlUUpe1LXwWnzheC-DGqeDS2yPf8oVj7oRphdHRib4NxjdH4iuB81Vj3VJAsKDThkhA68xfK2yl5RQVIZgDuEu0yeMW2l7InWT4D9Yx0eT-Xgtq0jRxlN8 Aug 24 07:57:28.004184 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 07:57:28.004184 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 07:57:28.004184 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 07:57:28.004184 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 07:57:28.004184 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 07:57:28.004184 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 07:57:28.004184 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: e52495240cf04548a21b411c32bbe1e1 Aug 24 07:57:28.004184 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1800569160 Aug 24 07:57:28.004184 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 07:57:28.004184 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 07:57:28.005843 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_e52495240cf04548a21b411c32bbe1e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/e52495240cf04548a21b411c32bbe1e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/e52495240cf04548a21b411c32bbe1e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/e52495240cf04548a21b411c32bbe1e1"}]}] Aug 24 07:57:28.005843 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1800569160 Aug 24 07:57:28.005843 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: e52495240cf04548a21b411c32bbe1e1 Aug 24 07:57:28.005843 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1800569160 Aug 24 07:57:28.005843 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-ServerRescueNegativeTestJSON-1800569160-project Aug 24 07:57:28.005843 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 07:57:28.005843 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 07:57:28.005843 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 51729e82a3784d04aef89ed83f1576bd Aug 24 07:57:28.005843 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1800569160-project Aug 24 07:57:28.005843 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Aug 24 07:57:28.005843 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {"volumeAttachment": {"volumeId": "30e6b980-35a9-4a69-81f9-51ee7c9d9a0b"}} Aug 24 07:57:28.005843 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 07:57:28.006703 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Cannot 'attach_volume' instance fb0fc412-e048-4edd-9a89-5aaaebb38a42 while it is in vm_state rescued Aug 24 07:57:28.006703 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'server_id': 'fb0fc412-e048-4edd-9a89-5aaaebb38a42', 'body': {'volumeAttachment': {'volumeId': '30e6b980-35a9-4a69-81f9-51ee7c9d9a0b'}}} Aug 24 07:57:28.006703 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:57:28.006703 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:57:28.006703 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 07:57:28.006703 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 07:57:28.006703 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 07:57:28.006703 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 07:57:28.006703 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 07:57:28.006703 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 07:57:28.006703 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fb0fc412-e048-4edd-9a89-5aaaebb38a42 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 07:57:28.006703 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:57:28.006703 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:57:28.006703 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:57:28.006703 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:57:28.006703 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:57:28.006703 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:57:28.006703 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:57:28.006703 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:57:28.007995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:57:28.007995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:57:28.007995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 07:57:28.007995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 07:57:28.007995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 07:57:28.007995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 07:57:28.007995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 07:57:28.007995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 07:57:28.007995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 07:57:28.007995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 07:57:28.007995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 07:57:28.007995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 07:57:28.007995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance fb0fc412-e048-4edd-9a89-5aaaebb38a42 while it is in vm_state rescued Aug 24 07:57:28.007995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:57:28.007995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:57:28.007995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:57:28.007995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:57:28.007995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:57:28.007995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:57:28.015370 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:57:28.015370 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:57:28.015370 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance fb0fc412-e048-4edd-9a89-5aaaebb38a42 while it is in vm_state rescued Aug 24 07:57:28.015370 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:57:28.015370 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b1a66008-3405-49e9-a3b5-bdd90b2ef0d5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Returning 409 to user: Cannot 'attach_volume' instance fb0fc412-e048-4edd-9a89-5aaaebb38a42 while it is in vm_state rescued {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:57:28.015370 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-b1a66008-3405-49e9-a3b5-bdd90b2ef0d5 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "POST /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.063251 Aug 24 07:57:28.015370 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 116/236] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 24 07:57:27 2022] POST /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42/os-volume_attachments => generated 152 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 07:57:28.022258 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-063a91b9-4166-4db5-9248-095b3d353c0a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:28.023489 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-063a91b9-4166-4db5-9248-095b3d353c0a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:28.030114 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-063a91b9-4166-4db5-9248-095b3d353c0a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:28.030852 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-063a91b9-4166-4db5-9248-095b3d353c0a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:28.032133 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-063a91b9-4166-4db5-9248-095b3d353c0a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:28.035717 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-063a91b9-4166-4db5-9248-095b3d353c0a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:28.035717 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-063a91b9-4166-4db5-9248-095b3d353c0a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:28.035717 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-063a91b9-4166-4db5-9248-095b3d353c0a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:28.254891 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-063a91b9-4166-4db5-9248-095b3d353c0a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "POST /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42/action" status: 202 len: 0 microversion: 2.1 time: 0.237204 Aug 24 07:57:28.259032 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 121/237] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 24 07:57:28 2022] POST /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:57:28.264428 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-5a9a7961-3791-4c3f-a1b9-f5fa4beb4448 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:28.265089 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-5a9a7961-3791-4c3f-a1b9-f5fa4beb4448 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:28.271532 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5a9a7961-3791-4c3f-a1b9-f5fa4beb4448 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:28.272012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5a9a7961-3791-4c3f-a1b9-f5fa4beb4448 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:28.272443 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5a9a7961-3791-4c3f-a1b9-f5fa4beb4448 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:28.273271 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5a9a7961-3791-4c3f-a1b9-f5fa4beb4448 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:28.273726 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5a9a7961-3791-4c3f-a1b9-f5fa4beb4448 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:28.274330 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5a9a7961-3791-4c3f-a1b9-f5fa4beb4448 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:28.342529 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-6272d55b-9844-47e1-a4b0-1d416061fff5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:28.343498 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-6272d55b-9844-47e1-a4b0-1d416061fff5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:28.349847 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6272d55b-9844-47e1-a4b0-1d416061fff5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:28.350336 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6272d55b-9844-47e1-a4b0-1d416061fff5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:28.350773 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6272d55b-9844-47e1-a4b0-1d416061fff5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:28.351965 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6272d55b-9844-47e1-a4b0-1d416061fff5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:28.352593 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6272d55b-9844-47e1-a4b0-1d416061fff5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:28.352872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6272d55b-9844-47e1-a4b0-1d416061fff5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:28.372581 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:28.421477 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-5a9a7961-3791-4c3f-a1b9-f5fa4beb4448 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:28.430339 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-5a9a7961-3791-4c3f-a1b9-f5fa4beb4448 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 200 len: 1509 microversion: 2.1 time: 0.169093 Aug 24 07:57:28.431058 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 117/238] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:28 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:28.562567 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-05050b47-cdb3-4064-abb1-e148b858cdaa tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:28.563199 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-05050b47-cdb3-4064-abb1-e148b858cdaa tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:28.569492 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-05050b47-cdb3-4064-abb1-e148b858cdaa tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:28.570054 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-05050b47-cdb3-4064-abb1-e148b858cdaa tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:28.570554 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-05050b47-cdb3-4064-abb1-e148b858cdaa tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:28.571324 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-05050b47-cdb3-4064-abb1-e148b858cdaa tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:28.572001 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-05050b47-cdb3-4064-abb1-e148b858cdaa tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:28.572490 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-05050b47-cdb3-4064-abb1-e148b858cdaa tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:28.596510 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.objects.instance [None req-05050b47-cdb3-4064-abb1-e148b858cdaa tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lazy-loading 'flavor' on Instance uuid a266e179-03cc-40b3-902d-aab680174711 {{(pid=127589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:57:28.603600 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-6272d55b-9844-47e1-a4b0-1d416061fff5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:28.613315 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-6272d55b-9844-47e1-a4b0-1d416061fff5 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1313 microversion: 2.1 time: 0.274886 Aug 24 07:57:28.614019 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 122/239] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:28 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:29.262995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-05050b47-cdb3-4064-abb1-e148b858cdaa tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "POST /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711/action" status: 202 len: 0 microversion: 2.20 time: 0.704246 Aug 24 07:57:29.265931 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 118/240] 10.222.0.72 () {62 vars in 1319 bytes} [Wed Aug 24 07:57:28 2022] POST /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711/action => generated 0 bytes in 708 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 07:57:29.274733 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-3e1904c9-fdda-40df-86a1-35f4e71447db tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:29.275520 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-3e1904c9-fdda-40df-86a1-35f4e71447db tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:29.281588 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3e1904c9-fdda-40df-86a1-35f4e71447db tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:29.282062 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3e1904c9-fdda-40df-86a1-35f4e71447db tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:29.282492 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3e1904c9-fdda-40df-86a1-35f4e71447db tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:29.283187 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3e1904c9-fdda-40df-86a1-35f4e71447db tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:29.283635 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3e1904c9-fdda-40df-86a1-35f4e71447db tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:29.284307 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3e1904c9-fdda-40df-86a1-35f4e71447db tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:29.422146 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-3e1904c9-fdda-40df-86a1-35f4e71447db tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:29.430091 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-3e1904c9-fdda-40df-86a1-35f4e71447db tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:29.431619 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-3e1904c9-fdda-40df-86a1-35f4e71447db tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:29.432754 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-3e1904c9-fdda-40df-86a1-35f4e71447db tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1723 microversion: 2.20 time: 0.162331 Aug 24 07:57:29.433303 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 123/241] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:29 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:29.452447 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-01347edb-50e5-480c-bf1c-2c6f50f7ca70 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:29.453194 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-01347edb-50e5-480c-bf1c-2c6f50f7ca70 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:29.459575 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-01347edb-50e5-480c-bf1c-2c6f50f7ca70 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:29.460100 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-01347edb-50e5-480c-bf1c-2c6f50f7ca70 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:29.461090 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-01347edb-50e5-480c-bf1c-2c6f50f7ca70 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:29.461778 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-01347edb-50e5-480c-bf1c-2c6f50f7ca70 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:29.462221 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-01347edb-50e5-480c-bf1c-2c6f50f7ca70 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:29.462639 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-01347edb-50e5-480c-bf1c-2c6f50f7ca70 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:29.603880 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-01347edb-50e5-480c-bf1c-2c6f50f7ca70 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:29.613080 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-01347edb-50e5-480c-bf1c-2c6f50f7ca70 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 200 len: 1509 microversion: 2.1 time: 0.165266 Aug 24 07:57:29.613647 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 119/242] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:29 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:29.629074 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-5f6c4745-f28e-426d-a9a0-63e14d796fb2 req-99b00806-8594-4875-8f95-22c682ad3c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3", "name": "network-vif-plugged", "status": "completed", "tag": "a63a1dfa-d3cb-4860-961a-7e951b10e39b"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:29.636451 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-3be8bb13-422a-4643-8841-f64fb69a1cc1 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:29.637095 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-3be8bb13-422a-4643-8841-f64fb69a1cc1 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:29.639989 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-5f6c4745-f28e-426d-a9a0-63e14d796fb2 req-99b00806-8594-4875-8f95-22c682ad3c4a service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:29.640463 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-5f6c4745-f28e-426d-a9a0-63e14d796fb2 req-99b00806-8594-4875-8f95-22c682ad3c4a service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:29.641075 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-5f6c4745-f28e-426d-a9a0-63e14d796fb2 req-99b00806-8594-4875-8f95-22c682ad3c4a service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:29.643480 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3be8bb13-422a-4643-8841-f64fb69a1cc1 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:29.643967 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3be8bb13-422a-4643-8841-f64fb69a1cc1 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:29.644406 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3be8bb13-422a-4643-8841-f64fb69a1cc1 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:29.645132 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3be8bb13-422a-4643-8841-f64fb69a1cc1 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:29.645673 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3be8bb13-422a-4643-8841-f64fb69a1cc1 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:29.646096 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3be8bb13-422a-4643-8841-f64fb69a1cc1 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:29.653651 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-5f6c4745-f28e-426d-a9a0-63e14d796fb2 req-99b00806-8594-4875-8f95-22c682ad3c4a service nova] Creating event network-vif-plugged:a63a1dfa-d3cb-4860-961a-7e951b10e39b for instance 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 on hv-cinder-85427 Aug 24 07:57:29.658543 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-5f6c4745-f28e-426d-a9a0-63e14d796fb2 req-99b00806-8594-4875-8f95-22c682ad3c4a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047194 Aug 24 07:57:29.659383 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 124/243] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:57:29.779397 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-3be8bb13-422a-4643-8841-f64fb69a1cc1 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:29.783308 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:29.788337 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-3be8bb13-422a-4643-8841-f64fb69a1cc1 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1313 microversion: 2.1 time: 0.156674 Aug 24 07:57:29.789466 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 120/244] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:29 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:30.455872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-9fb7ba53-612c-47d7-b976-73aa7809e884 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:30.456566 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-9fb7ba53-612c-47d7-b976-73aa7809e884 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:30.463996 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9fb7ba53-612c-47d7-b976-73aa7809e884 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:30.464476 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9fb7ba53-612c-47d7-b976-73aa7809e884 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:30.464992 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9fb7ba53-612c-47d7-b976-73aa7809e884 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:30.465633 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9fb7ba53-612c-47d7-b976-73aa7809e884 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:30.466088 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9fb7ba53-612c-47d7-b976-73aa7809e884 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:30.466513 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9fb7ba53-612c-47d7-b976-73aa7809e884 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:30.605711 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9fb7ba53-612c-47d7-b976-73aa7809e884 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:30.614066 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9fb7ba53-612c-47d7-b976-73aa7809e884 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:30.615783 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9fb7ba53-612c-47d7-b976-73aa7809e884 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:30.617020 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-9fb7ba53-612c-47d7-b976-73aa7809e884 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1723 microversion: 2.20 time: 0.165440 Aug 24 07:57:30.622813 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 125/245] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:30 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:30.637896 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-89ec8e96-5959-41d8-a142-992da3d4d54a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:30.638448 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-89ec8e96-5959-41d8-a142-992da3d4d54a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:30.644970 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-89ec8e96-5959-41d8-a142-992da3d4d54a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:30.645460 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-89ec8e96-5959-41d8-a142-992da3d4d54a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:30.645897 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-89ec8e96-5959-41d8-a142-992da3d4d54a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:30.646600 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-89ec8e96-5959-41d8-a142-992da3d4d54a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:30.647058 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-89ec8e96-5959-41d8-a142-992da3d4d54a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:30.647486 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-89ec8e96-5959-41d8-a142-992da3d4d54a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:30.809452 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-100d7cde-9c2f-4075-bb99-83f2e7739f3d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:30.810663 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-100d7cde-9c2f-4075-bb99-83f2e7739f3d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:30.816978 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-100d7cde-9c2f-4075-bb99-83f2e7739f3d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:30.817609 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-100d7cde-9c2f-4075-bb99-83f2e7739f3d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:30.818034 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-100d7cde-9c2f-4075-bb99-83f2e7739f3d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:30.825139 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-100d7cde-9c2f-4075-bb99-83f2e7739f3d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:30.825139 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-100d7cde-9c2f-4075-bb99-83f2e7739f3d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:30.825139 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-100d7cde-9c2f-4075-bb99-83f2e7739f3d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:30.927880 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-89ec8e96-5959-41d8-a142-992da3d4d54a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:30.936428 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-89ec8e96-5959-41d8-a142-992da3d4d54a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 200 len: 1509 microversion: 2.1 time: 0.302181 Aug 24 07:57:30.937092 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 121/246] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:30 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 1509 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:30.955668 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-100d7cde-9c2f-4075-bb99-83f2e7739f3d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:30.963852 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-100d7cde-9c2f-4075-bb99-83f2e7739f3d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1313 microversion: 2.1 time: 0.158215 Aug 24 07:57:30.964402 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 126/247] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:30 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:31.640493 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b748005c-269b-44c2-9767-5590cede0d21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:31.641152 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-b748005c-269b-44c2-9767-5590cede0d21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:31.648546 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b748005c-269b-44c2-9767-5590cede0d21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:31.649067 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b748005c-269b-44c2-9767-5590cede0d21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:31.649509 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b748005c-269b-44c2-9767-5590cede0d21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:31.650212 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b748005c-269b-44c2-9767-5590cede0d21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:31.650664 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b748005c-269b-44c2-9767-5590cede0d21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:31.651092 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b748005c-269b-44c2-9767-5590cede0d21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:31.777549 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b748005c-269b-44c2-9767-5590cede0d21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:31.785815 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b748005c-269b-44c2-9767-5590cede0d21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:31.787330 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b748005c-269b-44c2-9767-5590cede0d21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:31.789036 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-b748005c-269b-44c2-9767-5590cede0d21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1723 microversion: 2.20 time: 0.152215 Aug 24 07:57:31.789594 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 122/248] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:31 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:31.957757 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-1aa2d6dc-2853-44a2-a8a3-2576cfb129e2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:31.958368 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-1aa2d6dc-2853-44a2-a8a3-2576cfb129e2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:31.965601 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1aa2d6dc-2853-44a2-a8a3-2576cfb129e2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:31.966089 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1aa2d6dc-2853-44a2-a8a3-2576cfb129e2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:31.966529 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1aa2d6dc-2853-44a2-a8a3-2576cfb129e2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:31.967222 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1aa2d6dc-2853-44a2-a8a3-2576cfb129e2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:31.967675 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1aa2d6dc-2853-44a2-a8a3-2576cfb129e2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:31.968104 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1aa2d6dc-2853-44a2-a8a3-2576cfb129e2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:31.989662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-50b2c048-1a40-4963-9e80-f735638606ba tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:31.989662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-50b2c048-1a40-4963-9e80-f735638606ba tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:31.991786 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-50b2c048-1a40-4963-9e80-f735638606ba tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:31.992299 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-50b2c048-1a40-4963-9e80-f735638606ba tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:31.992771 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-50b2c048-1a40-4963-9e80-f735638606ba tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:31.993467 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-50b2c048-1a40-4963-9e80-f735638606ba tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:31.993919 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-50b2c048-1a40-4963-9e80-f735638606ba tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:31.994337 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-50b2c048-1a40-4963-9e80-f735638606ba tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:32.103480 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-1aa2d6dc-2853-44a2-a8a3-2576cfb129e2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:32.115749 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-1aa2d6dc-2853-44a2-a8a3-2576cfb129e2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 200 len: 1515 microversion: 2.1 time: 0.157708 Aug 24 07:57:32.115749 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 127/249] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:31 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:32.129190 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-50b2c048-1a40-4963-9e80-f735638606ba tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:32.137586 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-50b2c048-1a40-4963-9e80-f735638606ba tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1313 microversion: 2.1 time: 0.156135 Aug 24 07:57:32.138149 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 123/250] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:31 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:32.811356 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-f635fb1d-77e9-4e82-acb8-9f740e2f71af tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:32.811953 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-f635fb1d-77e9-4e82-acb8-9f740e2f71af tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:32.818393 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f635fb1d-77e9-4e82-acb8-9f740e2f71af tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:32.818866 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f635fb1d-77e9-4e82-acb8-9f740e2f71af tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:32.819295 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f635fb1d-77e9-4e82-acb8-9f740e2f71af tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:32.820028 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f635fb1d-77e9-4e82-acb8-9f740e2f71af tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:32.820473 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f635fb1d-77e9-4e82-acb8-9f740e2f71af tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:32.820917 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f635fb1d-77e9-4e82-acb8-9f740e2f71af tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:32.958909 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-f635fb1d-77e9-4e82-acb8-9f740e2f71af tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:32.974853 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-f635fb1d-77e9-4e82-acb8-9f740e2f71af tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:32.978360 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-f635fb1d-77e9-4e82-acb8-9f740e2f71af tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:32.980246 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-f635fb1d-77e9-4e82-acb8-9f740e2f71af tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1723 microversion: 2.20 time: 0.172683 Aug 24 07:57:32.980969 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 128/251] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:32 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:33.159825 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-7ec041fe-ccd2-4dc1-87b6-ca27fb7c2464 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:33.160399 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-7ec041fe-ccd2-4dc1-87b6-ca27fb7c2464 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:33.167755 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7ec041fe-ccd2-4dc1-87b6-ca27fb7c2464 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:33.168242 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7ec041fe-ccd2-4dc1-87b6-ca27fb7c2464 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:33.168692 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7ec041fe-ccd2-4dc1-87b6-ca27fb7c2464 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:33.169391 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7ec041fe-ccd2-4dc1-87b6-ca27fb7c2464 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:33.169954 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7ec041fe-ccd2-4dc1-87b6-ca27fb7c2464 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:33.170386 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7ec041fe-ccd2-4dc1-87b6-ca27fb7c2464 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:33.304229 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7ec041fe-ccd2-4dc1-87b6-ca27fb7c2464 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:33.311820 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-7ec041fe-ccd2-4dc1-87b6-ca27fb7c2464 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1313 microversion: 2.1 time: 0.156542 Aug 24 07:57:33.312382 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 124/252] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:33 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:34.003376 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-88b2a1a1-b890-4510-a6f2-342f1d7133b1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:34.003971 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-88b2a1a1-b890-4510-a6f2-342f1d7133b1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:34.009891 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-88b2a1a1-b890-4510-a6f2-342f1d7133b1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:34.010376 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-88b2a1a1-b890-4510-a6f2-342f1d7133b1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:34.010787 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-88b2a1a1-b890-4510-a6f2-342f1d7133b1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:34.011465 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-88b2a1a1-b890-4510-a6f2-342f1d7133b1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:34.011910 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-88b2a1a1-b890-4510-a6f2-342f1d7133b1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:34.012326 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-88b2a1a1-b890-4510-a6f2-342f1d7133b1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:34.140531 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-88b2a1a1-b890-4510-a6f2-342f1d7133b1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:34.149978 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-88b2a1a1-b890-4510-a6f2-342f1d7133b1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:34.151493 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-88b2a1a1-b890-4510-a6f2-342f1d7133b1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:34.152867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-88b2a1a1-b890-4510-a6f2-342f1d7133b1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1723 microversion: 2.20 time: 0.153373 Aug 24 07:57:34.153743 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 129/253] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:33 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:34.332082 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-db0a7764-b7a2-48ee-a38e-55324f400771 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:34.332710 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-db0a7764-b7a2-48ee-a38e-55324f400771 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:34.340234 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-db0a7764-b7a2-48ee-a38e-55324f400771 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:34.340751 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-db0a7764-b7a2-48ee-a38e-55324f400771 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:34.341168 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-db0a7764-b7a2-48ee-a38e-55324f400771 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:34.341860 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-db0a7764-b7a2-48ee-a38e-55324f400771 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:34.342304 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-db0a7764-b7a2-48ee-a38e-55324f400771 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:34.342719 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-db0a7764-b7a2-48ee-a38e-55324f400771 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:34.470446 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-db0a7764-b7a2-48ee-a38e-55324f400771 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:34.478168 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-db0a7764-b7a2-48ee-a38e-55324f400771 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1313 microversion: 2.1 time: 0.149871 Aug 24 07:57:34.478715 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 125/254] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:34 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:35.177033 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-e09fd1e5-4efa-4417-a1e1-85cef69535de tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:35.177639 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-e09fd1e5-4efa-4417-a1e1-85cef69535de tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:35.184083 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e09fd1e5-4efa-4417-a1e1-85cef69535de tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:35.184560 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e09fd1e5-4efa-4417-a1e1-85cef69535de tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:35.185038 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e09fd1e5-4efa-4417-a1e1-85cef69535de tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:35.185722 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e09fd1e5-4efa-4417-a1e1-85cef69535de tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:35.186170 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e09fd1e5-4efa-4417-a1e1-85cef69535de tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:35.186587 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e09fd1e5-4efa-4417-a1e1-85cef69535de tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:35.319253 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-e09fd1e5-4efa-4417-a1e1-85cef69535de tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:35.328463 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-e09fd1e5-4efa-4417-a1e1-85cef69535de tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:35.329986 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-e09fd1e5-4efa-4417-a1e1-85cef69535de tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:35.331184 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-e09fd1e5-4efa-4417-a1e1-85cef69535de tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1723 microversion: 2.20 time: 0.158093 Aug 24 07:57:35.331732 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 130/255] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:35 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:35.499041 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-6e514f77-652a-4daa-ae89-2ec22a6f09ea tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:35.499641 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-6e514f77-652a-4daa-ae89-2ec22a6f09ea tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:35.506389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6e514f77-652a-4daa-ae89-2ec22a6f09ea tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:35.506865 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6e514f77-652a-4daa-ae89-2ec22a6f09ea tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:35.507858 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6e514f77-652a-4daa-ae89-2ec22a6f09ea tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:35.508548 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6e514f77-652a-4daa-ae89-2ec22a6f09ea tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:35.509146 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6e514f77-652a-4daa-ae89-2ec22a6f09ea tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:35.509569 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6e514f77-652a-4daa-ae89-2ec22a6f09ea tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:35.652147 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-6e514f77-652a-4daa-ae89-2ec22a6f09ea tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:35.660362 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-6e514f77-652a-4daa-ae89-2ec22a6f09ea tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1313 microversion: 2.1 time: 0.165185 Aug 24 07:57:35.661421 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 126/256] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:35 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:36.354014 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-45fbec30-e75e-4906-919a-18f8f29f7e78 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:36.354626 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-45fbec30-e75e-4906-919a-18f8f29f7e78 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:36.360771 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-45fbec30-e75e-4906-919a-18f8f29f7e78 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:36.361253 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-45fbec30-e75e-4906-919a-18f8f29f7e78 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:36.361682 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-45fbec30-e75e-4906-919a-18f8f29f7e78 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:36.362417 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-45fbec30-e75e-4906-919a-18f8f29f7e78 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:36.362860 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-45fbec30-e75e-4906-919a-18f8f29f7e78 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:36.363276 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-45fbec30-e75e-4906-919a-18f8f29f7e78 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:36.492632 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-45fbec30-e75e-4906-919a-18f8f29f7e78 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:36.500712 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-45fbec30-e75e-4906-919a-18f8f29f7e78 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:36.502255 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-45fbec30-e75e-4906-919a-18f8f29f7e78 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:36.503395 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-45fbec30-e75e-4906-919a-18f8f29f7e78 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1723 microversion: 2.20 time: 0.153400 Aug 24 07:57:36.503946 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 131/257] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:36 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:36.683038 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e0e3e571-688b-47f9-a6c5-2c81d07d1cf8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:36.683583 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-e0e3e571-688b-47f9-a6c5-2c81d07d1cf8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:36.690014 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e0e3e571-688b-47f9-a6c5-2c81d07d1cf8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:36.690494 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e0e3e571-688b-47f9-a6c5-2c81d07d1cf8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:36.690929 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e0e3e571-688b-47f9-a6c5-2c81d07d1cf8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:36.691625 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e0e3e571-688b-47f9-a6c5-2c81d07d1cf8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:36.692077 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e0e3e571-688b-47f9-a6c5-2c81d07d1cf8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:36.692499 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e0e3e571-688b-47f9-a6c5-2c81d07d1cf8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:36.820720 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e0e3e571-688b-47f9-a6c5-2c81d07d1cf8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:36.828373 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-e0e3e571-688b-47f9-a6c5-2c81d07d1cf8 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1313 microversion: 2.1 time: 0.149160 Aug 24 07:57:36.829116 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 127/258] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:36 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:37.527029 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-c41a1d12-d7b9-4b46-823b-0d504e8c5c8d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:37.527636 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-c41a1d12-d7b9-4b46-823b-0d504e8c5c8d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:37.533985 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c41a1d12-d7b9-4b46-823b-0d504e8c5c8d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:37.534473 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c41a1d12-d7b9-4b46-823b-0d504e8c5c8d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:37.534910 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c41a1d12-d7b9-4b46-823b-0d504e8c5c8d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:37.535637 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c41a1d12-d7b9-4b46-823b-0d504e8c5c8d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:37.536098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c41a1d12-d7b9-4b46-823b-0d504e8c5c8d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:37.536522 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c41a1d12-d7b9-4b46-823b-0d504e8c5c8d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:37.665335 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-c41a1d12-d7b9-4b46-823b-0d504e8c5c8d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:37.674406 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-c41a1d12-d7b9-4b46-823b-0d504e8c5c8d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:37.675952 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-c41a1d12-d7b9-4b46-823b-0d504e8c5c8d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:37.677175 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-c41a1d12-d7b9-4b46-823b-0d504e8c5c8d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1723 microversion: 2.20 time: 0.154174 Aug 24 07:57:37.677755 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 132/259] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:37 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:37.849353 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-3c6770e5-cec0-44bc-8cb3-440e093bf499 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:37.849968 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-3c6770e5-cec0-44bc-8cb3-440e093bf499 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:37.857067 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3c6770e5-cec0-44bc-8cb3-440e093bf499 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:37.857549 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3c6770e5-cec0-44bc-8cb3-440e093bf499 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:37.857985 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3c6770e5-cec0-44bc-8cb3-440e093bf499 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:37.858674 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3c6770e5-cec0-44bc-8cb3-440e093bf499 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:37.859128 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3c6770e5-cec0-44bc-8cb3-440e093bf499 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:37.859551 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3c6770e5-cec0-44bc-8cb3-440e093bf499 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:37.992438 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-3c6770e5-cec0-44bc-8cb3-440e093bf499 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:38.000121 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-3c6770e5-cec0-44bc-8cb3-440e093bf499 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1313 microversion: 2.1 time: 0.154635 Aug 24 07:57:38.000693 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 128/260] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:37 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:38.702301 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-49746721-f57f-44ee-97ce-6a24d9ab8ef6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:38.702904 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-49746721-f57f-44ee-97ce-6a24d9ab8ef6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:38.708996 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-49746721-f57f-44ee-97ce-6a24d9ab8ef6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:38.709464 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-49746721-f57f-44ee-97ce-6a24d9ab8ef6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:38.710588 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-49746721-f57f-44ee-97ce-6a24d9ab8ef6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:38.711188 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-49746721-f57f-44ee-97ce-6a24d9ab8ef6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:38.711633 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-49746721-f57f-44ee-97ce-6a24d9ab8ef6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:38.712046 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-49746721-f57f-44ee-97ce-6a24d9ab8ef6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:38.842645 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-49746721-f57f-44ee-97ce-6a24d9ab8ef6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:38.850668 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-49746721-f57f-44ee-97ce-6a24d9ab8ef6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:38.852146 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-49746721-f57f-44ee-97ce-6a24d9ab8ef6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:38.853309 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-49746721-f57f-44ee-97ce-6a24d9ab8ef6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1723 microversion: 2.20 time: 0.155022 Aug 24 07:57:38.853858 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 133/261] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:38 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:39.020378 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-6d696730-5115-4aa9-8be2-912fa2830e5c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:39.021101 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-6d696730-5115-4aa9-8be2-912fa2830e5c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:39.028639 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6d696730-5115-4aa9-8be2-912fa2830e5c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:39.029151 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6d696730-5115-4aa9-8be2-912fa2830e5c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:39.029588 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6d696730-5115-4aa9-8be2-912fa2830e5c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:39.030292 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6d696730-5115-4aa9-8be2-912fa2830e5c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:39.030755 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6d696730-5115-4aa9-8be2-912fa2830e5c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:39.031177 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6d696730-5115-4aa9-8be2-912fa2830e5c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:39.158840 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-6d696730-5115-4aa9-8be2-912fa2830e5c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:39.166495 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-6d696730-5115-4aa9-8be2-912fa2830e5c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1313 microversion: 2.1 time: 0.150013 Aug 24 07:57:39.167049 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 129/262] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:39 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:39.875286 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-2787b52f-9ec7-4fe4-b9a4-c8c14cff98d7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:39.875875 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-2787b52f-9ec7-4fe4-b9a4-c8c14cff98d7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:39.881816 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2787b52f-9ec7-4fe4-b9a4-c8c14cff98d7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:39.882300 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2787b52f-9ec7-4fe4-b9a4-c8c14cff98d7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:39.882787 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2787b52f-9ec7-4fe4-b9a4-c8c14cff98d7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:39.883489 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2787b52f-9ec7-4fe4-b9a4-c8c14cff98d7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:39.883939 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2787b52f-9ec7-4fe4-b9a4-c8c14cff98d7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:39.884363 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2787b52f-9ec7-4fe4-b9a4-c8c14cff98d7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:40.016967 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-2787b52f-9ec7-4fe4-b9a4-c8c14cff98d7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:40.027146 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-2787b52f-9ec7-4fe4-b9a4-c8c14cff98d7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:40.028747 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-2787b52f-9ec7-4fe4-b9a4-c8c14cff98d7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:40.029817 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-2787b52f-9ec7-4fe4-b9a4-c8c14cff98d7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1723 microversion: 2.20 time: 0.158678 Aug 24 07:57:40.030359 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 134/263] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:39 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:40.187202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-7aa74148-9f03-4e6c-9792-fe6e876e5fec tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:40.187902 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-7aa74148-9f03-4e6c-9792-fe6e876e5fec tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:40.194829 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7aa74148-9f03-4e6c-9792-fe6e876e5fec tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:40.195316 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7aa74148-9f03-4e6c-9792-fe6e876e5fec tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:40.195749 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7aa74148-9f03-4e6c-9792-fe6e876e5fec tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:40.196440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7aa74148-9f03-4e6c-9792-fe6e876e5fec tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:40.196910 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7aa74148-9f03-4e6c-9792-fe6e876e5fec tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:40.197335 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7aa74148-9f03-4e6c-9792-fe6e876e5fec tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:40.295699 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-eb96ff87-6f2f-487c-b1c4-7c98f78fb632 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Action: 'create', calling method: .version_select at 0x7f320c37eee0>, body: {"keypair": {"name": "tempest-keypair-322158287", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEF9xSgVX+WSgZAQD1BFaN8zsHC77X5L3czKkS3r4cNH9PKiy+FNukLQ4ZSFIkF1LRrJ3EpZDkKOQ2In7D/de76XpwtGrbOVE9FT1SH11hOPY7lOwXRY9IuvCgt7fewhcA=="}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:40.311195 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-eb96ff87-6f2f-487c-b1c4-7c98f78fb632 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Getting quotas for project e52495240cf04548a21b411c32bbe1e1. Resources: {'key_pairs'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:57:40.315043 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-eb96ff87-6f2f-487c-b1c4-7c98f78fb632 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Getting quotas for user 51729e82a3784d04aef89ed83f1576bd and project e52495240cf04548a21b411c32bbe1e1. Resources: {'key_pairs'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:57:40.352377 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7aa74148-9f03-4e6c-9792-fe6e876e5fec tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:40.360222 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-7aa74148-9f03-4e6c-9792-fe6e876e5fec tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1313 microversion: 2.1 time: 0.176819 Aug 24 07:57:40.360806 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 130/264] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:40 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:40.429342 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-eb96ff87-6f2f-487c-b1c4-7c98f78fb632 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.137664 Aug 24 07:57:40.429939 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 135/265] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 24 07:57:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:57:41.059541 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-8d73eeb6-a60e-4dd1-b51e-4af8b2c33efe tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:41.059541 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-8d73eeb6-a60e-4dd1-b51e-4af8b2c33efe tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:41.067359 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=64 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:41.070151 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8d73eeb6-a60e-4dd1-b51e-4af8b2c33efe tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:41.071021 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8d73eeb6-a60e-4dd1-b51e-4af8b2c33efe tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:41.071594 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8d73eeb6-a60e-4dd1-b51e-4af8b2c33efe tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:41.072682 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8d73eeb6-a60e-4dd1-b51e-4af8b2c33efe tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:41.073451 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8d73eeb6-a60e-4dd1-b51e-4af8b2c33efe tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:41.074129 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8d73eeb6-a60e-4dd1-b51e-4af8b2c33efe tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:41.230171 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-8d73eeb6-a60e-4dd1-b51e-4af8b2c33efe tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:41.238675 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-8d73eeb6-a60e-4dd1-b51e-4af8b2c33efe tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:41.240185 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-8d73eeb6-a60e-4dd1-b51e-4af8b2c33efe tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:41.241963 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-8d73eeb6-a60e-4dd1-b51e-4af8b2c33efe tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1723 microversion: 2.20 time: 0.190977 Aug 24 07:57:41.243054 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 131/266] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:41 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:41.380959 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-78745536-ef05-4957-bcaa-d275fa928e4d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:41.381730 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-78745536-ef05-4957-bcaa-d275fa928e4d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:41.387609 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-78745536-ef05-4957-bcaa-d275fa928e4d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:41.388081 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-78745536-ef05-4957-bcaa-d275fa928e4d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:41.388508 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-78745536-ef05-4957-bcaa-d275fa928e4d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:41.389214 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-78745536-ef05-4957-bcaa-d275fa928e4d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:41.389659 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-78745536-ef05-4957-bcaa-d275fa928e4d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:41.390079 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-78745536-ef05-4957-bcaa-d275fa928e4d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:41.523081 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-78745536-ef05-4957-bcaa-d275fa928e4d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:41.531553 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-78745536-ef05-4957-bcaa-d275fa928e4d tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1313 microversion: 2.1 time: 0.154393 Aug 24 07:57:41.532282 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 136/267] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:41 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:42.264046 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-1ed4224b-9cd1-4f8d-a969-cca0b10a6ea7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:42.264712 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-1ed4224b-9cd1-4f8d-a969-cca0b10a6ea7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:42.271502 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1ed4224b-9cd1-4f8d-a969-cca0b10a6ea7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:42.271864 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1ed4224b-9cd1-4f8d-a969-cca0b10a6ea7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:42.272308 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1ed4224b-9cd1-4f8d-a969-cca0b10a6ea7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:42.273046 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1ed4224b-9cd1-4f8d-a969-cca0b10a6ea7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:42.273505 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1ed4224b-9cd1-4f8d-a969-cca0b10a6ea7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:42.274006 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1ed4224b-9cd1-4f8d-a969-cca0b10a6ea7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:42.554548 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-5ec0436a-b8bc-4fb6-b95c-5e1f2b7342c0 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:42.555166 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-5ec0436a-b8bc-4fb6-b95c-5e1f2b7342c0 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:42.558178 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:42.563062 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5ec0436a-b8bc-4fb6-b95c-5e1f2b7342c0 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:42.563778 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5ec0436a-b8bc-4fb6-b95c-5e1f2b7342c0 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:42.564384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5ec0436a-b8bc-4fb6-b95c-5e1f2b7342c0 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:42.565193 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5ec0436a-b8bc-4fb6-b95c-5e1f2b7342c0 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:42.565648 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5ec0436a-b8bc-4fb6-b95c-5e1f2b7342c0 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:42.566074 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5ec0436a-b8bc-4fb6-b95c-5e1f2b7342c0 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:42.705435 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-1ed4224b-9cd1-4f8d-a969-cca0b10a6ea7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:42.707320 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-5ec0436a-b8bc-4fb6-b95c-5e1f2b7342c0 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:42.715959 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-5ec0436a-b8bc-4fb6-b95c-5e1f2b7342c0 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1313 microversion: 2.1 time: 0.165499 Aug 24 07:57:42.730197 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-1ed4224b-9cd1-4f8d-a969-cca0b10a6ea7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:42.730379 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 137/268] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:42 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:42.730480 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-1ed4224b-9cd1-4f8d-a969-cca0b10a6ea7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:42.730480 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-1ed4224b-9cd1-4f8d-a969-cca0b10a6ea7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1723 microversion: 2.20 time: 0.459270 Aug 24 07:57:42.730480 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 132/269] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:42 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1723 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:43.110016 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-3954b3de-fc73-45c4-bc04-f82309285f9f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-789710099", "imageRef": "ccdab334-55ce-4ff5-bd97-5a424660c282", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "65ded553-11ab-4374-ae54-fd59db440a78"}], "security_groups": [{"name": "tempest-securitygroup--786048798"}], "key_name": "tempest-keypair-322158287", "user_data": "}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:43.267792 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.network.neutron [None req-3954b3de-fc73-45c4-bc04-f82309285f9f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] validate_networks() for [('65ded553-11ab-4374-ae54-fd59db440a78', None, None, None, None, None)] {{(pid=127590) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:57:43.740493 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-5d0d0534-0f54-4c4a-b499-02b7e25a4e63 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:43.741439 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-5d0d0534-0f54-4c4a-b499-02b7e25a4e63 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:43.752307 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5d0d0534-0f54-4c4a-b499-02b7e25a4e63 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:43.753018 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5d0d0534-0f54-4c4a-b499-02b7e25a4e63 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:43.753728 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5d0d0534-0f54-4c4a-b499-02b7e25a4e63 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:43.754746 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5d0d0534-0f54-4c4a-b499-02b7e25a4e63 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:43.755466 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5d0d0534-0f54-4c4a-b499-02b7e25a4e63 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:43.755951 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5d0d0534-0f54-4c4a-b499-02b7e25a4e63 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:43.932767 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-5d0d0534-0f54-4c4a-b499-02b7e25a4e63 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:43.938646 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-5d0d0534-0f54-4c4a-b499-02b7e25a4e63 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1498 microversion: 2.1 time: 0.205275 Aug 24 07:57:43.955605 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 133/270] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:43 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1498 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:43.962937 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-f331fd9a-47c6-4cfc-86a8-c723d6114223 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:43.963829 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-f331fd9a-47c6-4cfc-86a8-c723d6114223 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:43.971061 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f331fd9a-47c6-4cfc-86a8-c723d6114223 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:43.971830 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f331fd9a-47c6-4cfc-86a8-c723d6114223 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:43.973251 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f331fd9a-47c6-4cfc-86a8-c723d6114223 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:43.973616 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f331fd9a-47c6-4cfc-86a8-c723d6114223 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:43.974227 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f331fd9a-47c6-4cfc-86a8-c723d6114223 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:43.974648 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f331fd9a-47c6-4cfc-86a8-c723d6114223 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:44.005402 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-3954b3de-fc73-45c4-bc04-f82309285f9f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Flavor limits 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:57:44.006187 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-3954b3de-fc73-45c4-bc04-f82309285f9f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Image limits 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:57:44.007499 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-3954b3de-fc73-45c4-bc04-f82309285f9f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Flavor pref 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:57:44.008260 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-3954b3de-fc73-45c4-bc04-f82309285f9f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Image pref 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:57:44.008807 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-3954b3de-fc73-45c4-bc04-f82309285f9f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:57:44.039183 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3954b3de-fc73-45c4-bc04-f82309285f9f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:44.039921 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3954b3de-fc73-45c4-bc04-f82309285f9f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:44.040330 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3954b3de-fc73-45c4-bc04-f82309285f9f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:44.041353 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3954b3de-fc73-45c4-bc04-f82309285f9f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:44.041968 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3954b3de-fc73-45c4-bc04-f82309285f9f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:44.042613 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3954b3de-fc73-45c4-bc04-f82309285f9f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:44.063151 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-3954b3de-fc73-45c4-bc04-f82309285f9f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Getting quotas for project e52495240cf04548a21b411c32bbe1e1. Resources: {'cores', 'instances', 'ram'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:57:44.067643 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-3954b3de-fc73-45c4-bc04-f82309285f9f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Getting quotas for user 51729e82a3784d04aef89ed83f1576bd and project e52495240cf04548a21b411c32bbe1e1. Resources: {'cores', 'instances', 'ram'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:57:44.081291 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-3954b3de-fc73-45c4-bc04-f82309285f9f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Going to run 1 instances... {{(pid=127590) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:57:44.083208 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-3954b3de-fc73-45c4-bc04-f82309285f9f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccdab334-55ce-4ff5-bd97-5a424660c282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:57:44.129400 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-f331fd9a-47c6-4cfc-86a8-c723d6114223 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:44.148930 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-f331fd9a-47c6-4cfc-86a8-c723d6114223 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:44.151201 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-f331fd9a-47c6-4cfc-86a8-c723d6114223 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:44.152772 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-f331fd9a-47c6-4cfc-86a8-c723d6114223 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1723 microversion: 2.20 time: 0.195721 Aug 24 07:57:44.153576 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 134/271] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:43 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:44.301037 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-3954b3de-fc73-45c4-bc04-f82309285f9f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.195600 Aug 24 07:57:44.301706 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 138/272] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 24 07:57:43 2022] POST /compute/v2.1/servers => generated 408 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:57:44.313510 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-0b192967-7715-4cf3-a154-3c6a0cb7c0fe tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:44.314147 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-0b192967-7715-4cf3-a154-3c6a0cb7c0fe tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:44.388546 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-0b192967-7715-4cf3-a154-3c6a0cb7c0fe tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:44.395579 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-0b192967-7715-4cf3-a154-3c6a0cb7c0fe tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1244 microversion: 2.1 time: 0.086052 Aug 24 07:57:44.396166 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 135/273] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:44 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:45.176585 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-c09804c2-5422-4289-903d-ff3f4214489d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:45.177230 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-c09804c2-5422-4289-903d-ff3f4214489d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:45.195214 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c09804c2-5422-4289-903d-ff3f4214489d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:45.199098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c09804c2-5422-4289-903d-ff3f4214489d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:45.199098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c09804c2-5422-4289-903d-ff3f4214489d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:45.199098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c09804c2-5422-4289-903d-ff3f4214489d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:45.199098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c09804c2-5422-4289-903d-ff3f4214489d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:45.199665 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c09804c2-5422-4289-903d-ff3f4214489d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:45.204264 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-d7c3860e-05f0-4ada-afb2-be9c27951a45 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:45.204832 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-d7c3860e-05f0-4ada-afb2-be9c27951a45 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:45.227605 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d7c3860e-05f0-4ada-afb2-be9c27951a45 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:45.228100 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d7c3860e-05f0-4ada-afb2-be9c27951a45 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:45.228536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d7c3860e-05f0-4ada-afb2-be9c27951a45 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:45.245682 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d7c3860e-05f0-4ada-afb2-be9c27951a45 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:45.246178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d7c3860e-05f0-4ada-afb2-be9c27951a45 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:45.246623 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d7c3860e-05f0-4ada-afb2-be9c27951a45 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:45.293025 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-d7c3860e-05f0-4ada-afb2-be9c27951a45 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Going to try to terminate instance {{(pid=127589) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:57:45.424471 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-c09804c2-5422-4289-903d-ff3f4214489d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:45.436620 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-c09804c2-5422-4289-903d-ff3f4214489d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:45.443014 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-c09804c2-5422-4289-903d-ff3f4214489d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:45.445339 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-c09804c2-5422-4289-903d-ff3f4214489d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1723 microversion: 2.20 time: 0.272629 Aug 24 07:57:45.445987 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 139/274] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:45 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:45.451315 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-523bc2be-83b7-4463-b159-cda7346e1738 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:45.452099 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-523bc2be-83b7-4463-b159-cda7346e1738 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:45.459962 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-523bc2be-83b7-4463-b159-cda7346e1738 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:45.460835 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-523bc2be-83b7-4463-b159-cda7346e1738 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:45.461494 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-523bc2be-83b7-4463-b159-cda7346e1738 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:45.462365 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-523bc2be-83b7-4463-b159-cda7346e1738 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:45.462966 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-523bc2be-83b7-4463-b159-cda7346e1738 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:45.463557 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-523bc2be-83b7-4463-b159-cda7346e1738 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:45.465761 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:45.526592 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-523bc2be-83b7-4463-b159-cda7346e1738 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:45.535320 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-523bc2be-83b7-4463-b159-cda7346e1738 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1248 microversion: 2.1 time: 0.087990 Aug 24 07:57:45.536631 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 140/275] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:45 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1248 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:45.687189 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-d7c3860e-05f0-4ada-afb2-be9c27951a45 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 204 len: 0 microversion: 2.1 time: 0.493196 Aug 24 07:57:45.687963 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 136/276] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 24 07:57:45 2022] DELETE /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 07:57:45.696581 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-a8c182f7-054e-4178-9c6c-194b70321841 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:45.697241 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-a8c182f7-054e-4178-9c6c-194b70321841 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:45.703259 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a8c182f7-054e-4178-9c6c-194b70321841 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:45.703735 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a8c182f7-054e-4178-9c6c-194b70321841 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:45.704163 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a8c182f7-054e-4178-9c6c-194b70321841 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:45.704889 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a8c182f7-054e-4178-9c6c-194b70321841 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:45.705472 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a8c182f7-054e-4178-9c6c-194b70321841 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:45.705890 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a8c182f7-054e-4178-9c6c-194b70321841 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:45.724802 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=100 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:45.842246 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-a8c182f7-054e-4178-9c6c-194b70321841 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:45.850226 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-a8c182f7-054e-4178-9c6c-194b70321841 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1504 microversion: 2.1 time: 0.158004 Aug 24 07:57:45.850787 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 141/277] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:45 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:46.472419 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-c2fa8061-e378-4199-a345-f614c1658486 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:46.473074 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-c2fa8061-e378-4199-a345-f614c1658486 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:46.480407 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c2fa8061-e378-4199-a345-f614c1658486 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:46.480853 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c2fa8061-e378-4199-a345-f614c1658486 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:46.481284 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c2fa8061-e378-4199-a345-f614c1658486 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:46.481969 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c2fa8061-e378-4199-a345-f614c1658486 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:46.482418 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c2fa8061-e378-4199-a345-f614c1658486 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:46.482838 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c2fa8061-e378-4199-a345-f614c1658486 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:46.556074 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-7f49c67b-c6aa-4050-b1ea-4943c4bf89d1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:46.556736 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-7f49c67b-c6aa-4050-b1ea-4943c4bf89d1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:46.563096 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7f49c67b-c6aa-4050-b1ea-4943c4bf89d1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:46.563613 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7f49c67b-c6aa-4050-b1ea-4943c4bf89d1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:46.564011 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7f49c67b-c6aa-4050-b1ea-4943c4bf89d1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:46.564721 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7f49c67b-c6aa-4050-b1ea-4943c4bf89d1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:46.565168 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7f49c67b-c6aa-4050-b1ea-4943c4bf89d1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:46.565582 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7f49c67b-c6aa-4050-b1ea-4943c4bf89d1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:46.620623 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-c2fa8061-e378-4199-a345-f614c1658486 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:46.625494 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-7f49c67b-c6aa-4050-b1ea-4943c4bf89d1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:46.629609 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-c2fa8061-e378-4199-a345-f614c1658486 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:46.631132 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-c2fa8061-e378-4199-a345-f614c1658486 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:46.632289 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-c2fa8061-e378-4199-a345-f614c1658486 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1723 microversion: 2.20 time: 0.164684 Aug 24 07:57:46.633190 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 137/278] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:46 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:46.643174 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-7f49c67b-c6aa-4050-b1ea-4943c4bf89d1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1240 microversion: 2.1 time: 0.091567 Aug 24 07:57:46.645077 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 142/279] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:46 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1240 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:46.870569 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-3b80054c-3309-4f94-85c4-1ba4e0d8b915 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:46.871220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-3b80054c-3309-4f94-85c4-1ba4e0d8b915 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:46.877696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3b80054c-3309-4f94-85c4-1ba4e0d8b915 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:46.878182 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3b80054c-3309-4f94-85c4-1ba4e0d8b915 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:46.878619 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3b80054c-3309-4f94-85c4-1ba4e0d8b915 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:46.879345 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3b80054c-3309-4f94-85c4-1ba4e0d8b915 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:46.879851 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3b80054c-3309-4f94-85c4-1ba4e0d8b915 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:46.880308 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3b80054c-3309-4f94-85c4-1ba4e0d8b915 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:47.017269 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-3b80054c-3309-4f94-85c4-1ba4e0d8b915 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:47.024998 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-3b80054c-3309-4f94-85c4-1ba4e0d8b915 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1504 microversion: 2.1 time: 0.158240 Aug 24 07:57:47.025570 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 138/280] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:46 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:47.660994 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-b6374185-c78b-468d-aab3-4063dbb512f9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:47.666365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-ee9c800b-1822-4f26-94a5-caf575d51c0c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:47.667033 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-ee9c800b-1822-4f26-94a5-caf575d51c0c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:47.670494 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-b6374185-c78b-468d-aab3-4063dbb512f9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:47.673995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ee9c800b-1822-4f26-94a5-caf575d51c0c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:47.674493 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ee9c800b-1822-4f26-94a5-caf575d51c0c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:47.674973 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ee9c800b-1822-4f26-94a5-caf575d51c0c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:47.675869 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ee9c800b-1822-4f26-94a5-caf575d51c0c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:47.676504 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ee9c800b-1822-4f26-94a5-caf575d51c0c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:47.676750 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b6374185-c78b-468d-aab3-4063dbb512f9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:47.676967 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ee9c800b-1822-4f26-94a5-caf575d51c0c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:47.677404 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b6374185-c78b-468d-aab3-4063dbb512f9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:47.677835 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b6374185-c78b-468d-aab3-4063dbb512f9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:47.679092 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b6374185-c78b-468d-aab3-4063dbb512f9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:47.679597 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b6374185-c78b-468d-aab3-4063dbb512f9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:47.680017 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b6374185-c78b-468d-aab3-4063dbb512f9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:47.749052 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-ee9c800b-1822-4f26-94a5-caf575d51c0c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:47.757721 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-ee9c800b-1822-4f26-94a5-caf575d51c0c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1296 microversion: 2.1 time: 0.094993 Aug 24 07:57:47.758298 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 139/281] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:47 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1296 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:47.826993 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-b6374185-c78b-468d-aab3-4063dbb512f9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:47.835366 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-b6374185-c78b-468d-aab3-4063dbb512f9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:47.836790 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-b6374185-c78b-468d-aab3-4063dbb512f9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:47.838372 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-b6374185-c78b-468d-aab3-4063dbb512f9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1744 microversion: 2.20 time: 0.184507 Aug 24 07:57:47.861483 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 143/282] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:47 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1744 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:48.047982 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-c541a794-3eb2-45fb-b83d-b50cfce583e2 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:48.048837 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-c541a794-3eb2-45fb-b83d-b50cfce583e2 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:48.059474 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c541a794-3eb2-45fb-b83d-b50cfce583e2 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:48.061638 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c541a794-3eb2-45fb-b83d-b50cfce583e2 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:48.063516 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c541a794-3eb2-45fb-b83d-b50cfce583e2 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:48.065534 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c541a794-3eb2-45fb-b83d-b50cfce583e2 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:48.067443 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c541a794-3eb2-45fb-b83d-b50cfce583e2 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:48.069929 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c541a794-3eb2-45fb-b83d-b50cfce583e2 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:48.213731 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-c541a794-3eb2-45fb-b83d-b50cfce583e2 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:48.221511 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-c541a794-3eb2-45fb-b83d-b50cfce583e2 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1504 microversion: 2.1 time: 0.178766 Aug 24 07:57:48.222073 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 140/283] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:48 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:48.780022 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-0f23c0ef-b9a7-437d-943e-b8efdf409e43 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:48.780557 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-0f23c0ef-b9a7-437d-943e-b8efdf409e43 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:48.788577 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0f23c0ef-b9a7-437d-943e-b8efdf409e43 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:48.788577 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0f23c0ef-b9a7-437d-943e-b8efdf409e43 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:48.788577 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0f23c0ef-b9a7-437d-943e-b8efdf409e43 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:48.789275 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0f23c0ef-b9a7-437d-943e-b8efdf409e43 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:48.789725 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0f23c0ef-b9a7-437d-943e-b8efdf409e43 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:48.790146 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0f23c0ef-b9a7-437d-943e-b8efdf409e43 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:48.860436 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-0f23c0ef-b9a7-437d-943e-b8efdf409e43 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:48.862072 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-65a7b2ad-83df-43ba-b8eb-39c5fbb129df tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:48.862684 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-65a7b2ad-83df-43ba-b8eb-39c5fbb129df tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:48.869303 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-0f23c0ef-b9a7-437d-943e-b8efdf409e43 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1296 microversion: 2.1 time: 0.094098 Aug 24 07:57:48.869934 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-65a7b2ad-83df-43ba-b8eb-39c5fbb129df tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:48.870140 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 144/284] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:48 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1296 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:48.870715 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-65a7b2ad-83df-43ba-b8eb-39c5fbb129df tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:48.871210 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-65a7b2ad-83df-43ba-b8eb-39c5fbb129df tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:48.871903 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-65a7b2ad-83df-43ba-b8eb-39c5fbb129df tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:48.872350 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-65a7b2ad-83df-43ba-b8eb-39c5fbb129df tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:48.872793 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-65a7b2ad-83df-43ba-b8eb-39c5fbb129df tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:49.019451 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-65a7b2ad-83df-43ba-b8eb-39c5fbb129df tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:49.028814 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-65a7b2ad-83df-43ba-b8eb-39c5fbb129df tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:49.030330 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-65a7b2ad-83df-43ba-b8eb-39c5fbb129df tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:49.031576 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-65a7b2ad-83df-43ba-b8eb-39c5fbb129df tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1744 microversion: 2.20 time: 0.173318 Aug 24 07:57:49.032078 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 141/285] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:48 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:57:49.243109 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-46b75896-9620-4a10-ac2e-f636e0b9ef6c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:49.243639 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-46b75896-9620-4a10-ac2e-f636e0b9ef6c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:49.249693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-46b75896-9620-4a10-ac2e-f636e0b9ef6c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:49.250177 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-46b75896-9620-4a10-ac2e-f636e0b9ef6c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:49.250616 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-46b75896-9620-4a10-ac2e-f636e0b9ef6c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:49.251310 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-46b75896-9620-4a10-ac2e-f636e0b9ef6c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:49.251792 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-46b75896-9620-4a10-ac2e-f636e0b9ef6c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:49.252225 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-46b75896-9620-4a10-ac2e-f636e0b9ef6c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:49.383115 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-46b75896-9620-4a10-ac2e-f636e0b9ef6c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:49.391113 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-46b75896-9620-4a10-ac2e-f636e0b9ef6c tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1504 microversion: 2.1 time: 0.151983 Aug 24 07:57:49.391667 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 145/286] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:49 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:49.890836 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-df92de46-34b9-46b2-9dd2-2299f6c1f069 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:49.891453 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-df92de46-34b9-46b2-9dd2-2299f6c1f069 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:49.897470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-df92de46-34b9-46b2-9dd2-2299f6c1f069 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:49.898477 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-df92de46-34b9-46b2-9dd2-2299f6c1f069 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:49.898927 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-df92de46-34b9-46b2-9dd2-2299f6c1f069 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:49.899819 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-df92de46-34b9-46b2-9dd2-2299f6c1f069 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:49.900433 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-df92de46-34b9-46b2-9dd2-2299f6c1f069 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:49.900881 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-df92de46-34b9-46b2-9dd2-2299f6c1f069 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:49.973166 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-df92de46-34b9-46b2-9dd2-2299f6c1f069 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:49.982283 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-df92de46-34b9-46b2-9dd2-2299f6c1f069 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1296 microversion: 2.1 time: 0.095348 Aug 24 07:57:49.983031 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 142/287] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:49 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1296 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:50.056502 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-9d318e5f-4904-4e2d-8e6d-6f2496d8def7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:50.057677 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-9d318e5f-4904-4e2d-8e6d-6f2496d8def7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:50.064706 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9d318e5f-4904-4e2d-8e6d-6f2496d8def7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:50.065390 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9d318e5f-4904-4e2d-8e6d-6f2496d8def7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:50.065937 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9d318e5f-4904-4e2d-8e6d-6f2496d8def7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:50.066835 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9d318e5f-4904-4e2d-8e6d-6f2496d8def7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:50.067445 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9d318e5f-4904-4e2d-8e6d-6f2496d8def7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:50.068024 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9d318e5f-4904-4e2d-8e6d-6f2496d8def7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:50.371614 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9d318e5f-4904-4e2d-8e6d-6f2496d8def7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:50.380708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9d318e5f-4904-4e2d-8e6d-6f2496d8def7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:50.382309 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9d318e5f-4904-4e2d-8e6d-6f2496d8def7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:50.383524 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-9d318e5f-4904-4e2d-8e6d-6f2496d8def7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1744 microversion: 2.20 time: 0.332126 Aug 24 07:57:50.393434 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 146/288] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:50 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1744 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:50.413120 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-f2922ad4-c66d-438f-b9c1-7bc2198e2957 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:50.414406 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-f2922ad4-c66d-438f-b9c1-7bc2198e2957 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:50.428640 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f2922ad4-c66d-438f-b9c1-7bc2198e2957 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:50.436737 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f2922ad4-c66d-438f-b9c1-7bc2198e2957 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:50.436737 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f2922ad4-c66d-438f-b9c1-7bc2198e2957 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:50.436737 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f2922ad4-c66d-438f-b9c1-7bc2198e2957 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:50.436737 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f2922ad4-c66d-438f-b9c1-7bc2198e2957 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:50.437093 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f2922ad4-c66d-438f-b9c1-7bc2198e2957 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:50.559701 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-f2922ad4-c66d-438f-b9c1-7bc2198e2957 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:50.569236 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-f2922ad4-c66d-438f-b9c1-7bc2198e2957 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1504 microversion: 2.1 time: 0.160074 Aug 24 07:57:50.569897 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 143/289] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:50 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:50.752051 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-6a11ad6a-04c1-4ffa-b356-221875ec018e req-d8552d83-b4cc-4ff7-90b4-4daa500f4fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3", "name": "network-vif-deleted", "tag": "a63a1dfa-d3cb-4860-961a-7e951b10e39b"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:50.762072 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-6a11ad6a-04c1-4ffa-b356-221875ec018e req-d8552d83-b4cc-4ff7-90b4-4daa500f4fa9 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:50.762546 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-6a11ad6a-04c1-4ffa-b356-221875ec018e req-d8552d83-b4cc-4ff7-90b4-4daa500f4fa9 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:50.762975 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-6a11ad6a-04c1-4ffa-b356-221875ec018e req-d8552d83-b4cc-4ff7-90b4-4daa500f4fa9 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:50.774835 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-6a11ad6a-04c1-4ffa-b356-221875ec018e req-d8552d83-b4cc-4ff7-90b4-4daa500f4fa9 service nova] Creating event network-vif-deleted:a63a1dfa-d3cb-4860-961a-7e951b10e39b for instance 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 on hv-cinder-85427 Aug 24 07:57:50.780713 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-6a11ad6a-04c1-4ffa-b356-221875ec018e req-d8552d83-b4cc-4ff7-90b4-4daa500f4fa9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031710 Aug 24 07:57:50.781063 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 147/290] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:57:51.005541 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-0a9c016a-93e3-4d2d-bfda-7f3a52317364 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:51.006146 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-0a9c016a-93e3-4d2d-bfda-7f3a52317364 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:51.020421 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0a9c016a-93e3-4d2d-bfda-7f3a52317364 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:51.021001 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0a9c016a-93e3-4d2d-bfda-7f3a52317364 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:51.021735 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0a9c016a-93e3-4d2d-bfda-7f3a52317364 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:51.022462 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0a9c016a-93e3-4d2d-bfda-7f3a52317364 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:51.023755 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0a9c016a-93e3-4d2d-bfda-7f3a52317364 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:51.024693 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0a9c016a-93e3-4d2d-bfda-7f3a52317364 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:51.103527 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-0a9c016a-93e3-4d2d-bfda-7f3a52317364 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:51.111998 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-0a9c016a-93e3-4d2d-bfda-7f3a52317364 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1296 microversion: 2.1 time: 0.111424 Aug 24 07:57:51.112856 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 144/291] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:50 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1296 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:51.409012 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-6f5c7701-6142-4344-9e52-4fd6f559ed98 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:51.409738 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-6f5c7701-6142-4344-9e52-4fd6f559ed98 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:51.416463 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6f5c7701-6142-4344-9e52-4fd6f559ed98 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:51.416980 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6f5c7701-6142-4344-9e52-4fd6f559ed98 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:51.417417 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6f5c7701-6142-4344-9e52-4fd6f559ed98 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:51.418241 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6f5c7701-6142-4344-9e52-4fd6f559ed98 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:51.418695 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6f5c7701-6142-4344-9e52-4fd6f559ed98 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:51.419121 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6f5c7701-6142-4344-9e52-4fd6f559ed98 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:51.584957 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-6f5c7701-6142-4344-9e52-4fd6f559ed98 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:51.589757 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-08984c04-bfca-4d7e-a6ae-85040312d98e tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:51.590383 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-08984c04-bfca-4d7e-a6ae-85040312d98e tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:51.592694 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-6f5c7701-6142-4344-9e52-4fd6f559ed98 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:51.594196 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-6f5c7701-6142-4344-9e52-4fd6f559ed98 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:51.595458 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-6f5c7701-6142-4344-9e52-4fd6f559ed98 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1744 microversion: 2.20 time: 0.191098 Aug 24 07:57:51.596998 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 148/292] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:51 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1744 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:51.597543 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-08984c04-bfca-4d7e-a6ae-85040312d98e tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:51.598058 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-08984c04-bfca-4d7e-a6ae-85040312d98e tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:51.598510 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-08984c04-bfca-4d7e-a6ae-85040312d98e tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:51.599229 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-08984c04-bfca-4d7e-a6ae-85040312d98e tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:51.599700 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-08984c04-bfca-4d7e-a6ae-85040312d98e tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:51.600117 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-08984c04-bfca-4d7e-a6ae-85040312d98e tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:51.664962 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-08984c04-bfca-4d7e-a6ae-85040312d98e tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:51.672698 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-08984c04-bfca-4d7e-a6ae-85040312d98e tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1462 microversion: 2.1 time: 0.086822 Aug 24 07:57:51.673255 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 145/293] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:51 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1462 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:52.136920 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-a482a8e3-21ad-41c5-bef9-224e14bd58ab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:52.137437 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-a482a8e3-21ad-41c5-bef9-224e14bd58ab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:52.143395 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a482a8e3-21ad-41c5-bef9-224e14bd58ab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:52.143875 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a482a8e3-21ad-41c5-bef9-224e14bd58ab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:52.144301 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a482a8e3-21ad-41c5-bef9-224e14bd58ab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:52.145002 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a482a8e3-21ad-41c5-bef9-224e14bd58ab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:52.145447 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a482a8e3-21ad-41c5-bef9-224e14bd58ab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:52.145867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a482a8e3-21ad-41c5-bef9-224e14bd58ab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:52.206949 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-a482a8e3-21ad-41c5-bef9-224e14bd58ab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:52.218028 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-a482a8e3-21ad-41c5-bef9-224e14bd58ab tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1296 microversion: 2.1 time: 0.084864 Aug 24 07:57:52.218633 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 149/294] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:52 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1296 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:52.619339 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b3f7cf01-bd0b-480f-be97-fde5f30060bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:52.619947 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-b3f7cf01-bd0b-480f-be97-fde5f30060bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:52.626294 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b3f7cf01-bd0b-480f-be97-fde5f30060bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:52.626878 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b3f7cf01-bd0b-480f-be97-fde5f30060bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:52.627340 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b3f7cf01-bd0b-480f-be97-fde5f30060bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:52.628032 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b3f7cf01-bd0b-480f-be97-fde5f30060bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:52.628512 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b3f7cf01-bd0b-480f-be97-fde5f30060bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:52.629016 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b3f7cf01-bd0b-480f-be97-fde5f30060bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:52.695359 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-18d8f795-b185-4db7-929e-95028800c440 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:52.696187 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-18d8f795-b185-4db7-929e-95028800c440 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:52.702673 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-18d8f795-b185-4db7-929e-95028800c440 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:52.703162 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-18d8f795-b185-4db7-929e-95028800c440 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:52.703772 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-18d8f795-b185-4db7-929e-95028800c440 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:52.704476 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-18d8f795-b185-4db7-929e-95028800c440 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:52.704945 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-18d8f795-b185-4db7-929e-95028800c440 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:52.705566 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-18d8f795-b185-4db7-929e-95028800c440 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:52.806986 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b3f7cf01-bd0b-480f-be97-fde5f30060bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:52.818015 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b3f7cf01-bd0b-480f-be97-fde5f30060bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:52.820242 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-18d8f795-b185-4db7-929e-95028800c440 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:52.820834 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b3f7cf01-bd0b-480f-be97-fde5f30060bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:52.822259 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-b3f7cf01-bd0b-480f-be97-fde5f30060bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1744 microversion: 2.20 time: 0.207365 Aug 24 07:57:52.823216 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 146/295] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:52 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1744 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:52.833578 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-18d8f795-b185-4db7-929e-95028800c440 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1462 microversion: 2.1 time: 0.142630 Aug 24 07:57:52.834902 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 150/296] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:52 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1462 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:53.238179 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-47e8e5fc-43d2-4bb4-ae92-9794c83bed88 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:53.238766 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-47e8e5fc-43d2-4bb4-ae92-9794c83bed88 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:53.245486 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-47e8e5fc-43d2-4bb4-ae92-9794c83bed88 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:53.245971 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-47e8e5fc-43d2-4bb4-ae92-9794c83bed88 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:53.246405 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-47e8e5fc-43d2-4bb4-ae92-9794c83bed88 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:53.247103 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-47e8e5fc-43d2-4bb4-ae92-9794c83bed88 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:53.247557 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-47e8e5fc-43d2-4bb4-ae92-9794c83bed88 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:53.247978 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-47e8e5fc-43d2-4bb4-ae92-9794c83bed88 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:53.308508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-47e8e5fc-43d2-4bb4-ae92-9794c83bed88 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:53.316024 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-47e8e5fc-43d2-4bb4-ae92-9794c83bed88 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1314 microversion: 2.1 time: 0.081784 Aug 24 07:57:53.316582 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 147/297] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:53 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1314 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:53.846153 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-19c63e43-a286-44c7-b775-57f27a937f97 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:53.846764 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-19c63e43-a286-44c7-b775-57f27a937f97 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:53.854568 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-19c63e43-a286-44c7-b775-57f27a937f97 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:53.855058 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-19c63e43-a286-44c7-b775-57f27a937f97 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:53.855491 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-19c63e43-a286-44c7-b775-57f27a937f97 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:53.856238 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-19c63e43-a286-44c7-b775-57f27a937f97 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:53.856698 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-19c63e43-a286-44c7-b775-57f27a937f97 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:53.857117 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-19c63e43-a286-44c7-b775-57f27a937f97 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:53.857940 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-24a7c071-38f4-4183-85ed-bdcd15416353 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:53.858658 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-24a7c071-38f4-4183-85ed-bdcd15416353 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:53.865351 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-24a7c071-38f4-4183-85ed-bdcd15416353 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:53.866239 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-24a7c071-38f4-4183-85ed-bdcd15416353 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:53.867336 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-24a7c071-38f4-4183-85ed-bdcd15416353 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:53.868431 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-24a7c071-38f4-4183-85ed-bdcd15416353 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:53.869139 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-24a7c071-38f4-4183-85ed-bdcd15416353 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:53.870028 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-24a7c071-38f4-4183-85ed-bdcd15416353 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:53.908928 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-24a7c071-38f4-4183-85ed-bdcd15416353 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:53.909504 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-24a7c071-38f4-4183-85ed-bdcd15416353 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:53.910023 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-24a7c071-38f4-4183-85ed-bdcd15416353 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:53.910536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.objects.instance [None req-24a7c071-38f4-4183-85ed-bdcd15416353 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lazy-loading 'fault' on Instance uuid 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 {{(pid=127589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:57:53.955979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-24a7c071-38f4-4183-85ed-bdcd15416353 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed5bde75f6d2477ab2747016ab5c309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6443ec0c49e58d3cdb373d681c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:53.963408 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-24a7c071-38f4-4183-85ed-bdcd15416353 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 200 len: 1303 microversion: 2.1 time: 0.111441 Aug 24 07:57:53.964062 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 148/298] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:53 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 1303 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:54.055520 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=2 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:54.076242 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=10 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:54.083448 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-19c63e43-a286-44c7-b775-57f27a937f97 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:54.100427 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-19c63e43-a286-44c7-b775-57f27a937f97 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:54.103434 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-19c63e43-a286-44c7-b775-57f27a937f97 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:54.106958 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-19c63e43-a286-44c7-b775-57f27a937f97 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1744 microversion: 2.20 time: 0.264652 Aug 24 07:57:54.108127 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 151/299] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:53 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1744 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:54.337764 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-d93b059a-3453-4b43-bb17-e6e03d91483c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:54.338391 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-d93b059a-3453-4b43-bb17-e6e03d91483c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:54.345499 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d93b059a-3453-4b43-bb17-e6e03d91483c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:54.345927 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d93b059a-3453-4b43-bb17-e6e03d91483c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:54.346364 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d93b059a-3453-4b43-bb17-e6e03d91483c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:54.347077 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d93b059a-3453-4b43-bb17-e6e03d91483c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:54.347528 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d93b059a-3453-4b43-bb17-e6e03d91483c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:54.347949 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d93b059a-3453-4b43-bb17-e6e03d91483c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:54.392634 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=2 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:54.524401 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-d93b059a-3453-4b43-bb17-e6e03d91483c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:54.533616 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-d93b059a-3453-4b43-bb17-e6e03d91483c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1369 microversion: 2.1 time: 0.200334 Aug 24 07:57:54.534843 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 149/300] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:54 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1369 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:54.875544 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-582debb5-9e9e-43f5-91c8-7d51f3ebfdb8 req-cf5e1bd6-5b3a-4b5e-9184-6617587af094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a266e179-03cc-40b3-902d-aab680174711", "name": "network-vif-plugged", "status": "completed", "tag": "45373581-1bd1-4a1b-aff0-a6e9993cd6b9"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:54.891830 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-8267e789-f257-4469-91fd-251d3e4f8aeb tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2044416482", "imageRef": "ccdab334-55ce-4ff5-bd97-5a424660c282", "flavorRef": "452"}} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:54.918444 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-582debb5-9e9e-43f5-91c8-7d51f3ebfdb8 req-cf5e1bd6-5b3a-4b5e-9184-6617587af094 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:54.918444 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-582debb5-9e9e-43f5-91c8-7d51f3ebfdb8 req-cf5e1bd6-5b3a-4b5e-9184-6617587af094 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:54.918444 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-582debb5-9e9e-43f5-91c8-7d51f3ebfdb8 req-cf5e1bd6-5b3a-4b5e-9184-6617587af094 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:54.936516 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-582debb5-9e9e-43f5-91c8-7d51f3ebfdb8 req-cf5e1bd6-5b3a-4b5e-9184-6617587af094 service nova] Creating event network-vif-plugged:45373581-1bd1-4a1b-aff0-a6e9993cd6b9 for instance a266e179-03cc-40b3-902d-aab680174711 on hv-cinder-85427 Aug 24 07:57:54.942362 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-582debb5-9e9e-43f5-91c8-7d51f3ebfdb8 req-cf5e1bd6-5b3a-4b5e-9184-6617587af094 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072770 Aug 24 07:57:54.944016 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 152/301] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:57:54.980680 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.network.neutron [None req-8267e789-f257-4469-91fd-251d3e4f8aeb tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] validate_networks() for None {{(pid=127589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:57:54.986162 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-111c2346-6351-40cd-beaa-ef08c6ae7693 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:54.986934 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-111c2346-6351-40cd-beaa-ef08c6ae7693 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] [instance: 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:54.993880 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-111c2346-6351-40cd-beaa-ef08c6ae7693 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:54.994370 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-111c2346-6351-40cd-beaa-ef08c6ae7693 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:54.994807 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-111c2346-6351-40cd-beaa-ef08c6ae7693 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:54.995517 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-111c2346-6351-40cd-beaa-ef08c6ae7693 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:54.995977 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-111c2346-6351-40cd-beaa-ef08c6ae7693 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:54.996404 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-111c2346-6351-40cd-beaa-ef08c6ae7693 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:55.016116 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.wsgi [None req-111c2346-6351-40cd-beaa-ef08c6ae7693 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] HTTP exception thrown: Instance 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 could not be found. Aug 24 07:57:55.016116 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-111c2346-6351-40cd-beaa-ef08c6ae7693 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Request method failure captured: Aug 24 07:57:55.016116 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: request: GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 HTTP/1.1 Aug 24 07:57:55.016116 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept: application/json Aug 24 07:57:55.016116 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept-Encoding: identity Aug 24 07:57:55.016116 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Connection: close Aug 24 07:57:55.016116 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Length: 0 Aug 24 07:57:55.016116 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Type: application/json Aug 24 07:57:55.016116 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Host: 10.222.0.72 Aug 24 07:57:55.016116 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Openstack-System-Scope: None Aug 24 07:57:55.016116 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: User-Agent: python-urllib3/1.26.11 Aug 24 07:57:55.016116 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Auth-Token: gAAAAABjBdmy0pNjy140VpPbw3T3MSe-eEJp7i800zHWXCfzOfe86TFq1QN-ZAvxixaNwC77wEXyJPfn3BWsP3_z1dSFIC03espJG7uxGr0H9FdvdGo4svOo95xTvn4welPepCiJc6qHKl2JDfeWkJMLTUFwr67WvN2-7oITFiWtv6snP2-iX4k Aug 24 07:57:55.016116 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Id: None Aug 24 07:57:55.016116 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Name: None Aug 24 07:57:55.016116 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Identity-Status: Confirmed Aug 24 07:57:55.016116 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Is-Admin-Project: True Aug 24 07:57:55.016116 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Id: default Aug 24 07:57:55.016116 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Name: Default Aug 24 07:57:55.016116 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Id: 647a6443ec0c49e58d3cdb373d681c38 Aug 24 07:57:55.016116 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Name: tempest-VolumesActionsTest-1050177248 Aug 24 07:57:55.016116 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Role: reader,member Aug 24 07:57:55.016116 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Roles: reader,member Aug 24 07:57:55.017738 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_647a6443ec0c49e58d3cdb373d681c38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/647a6443ec0c49e58d3cdb373d681c38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/647a6443ec0c49e58d3cdb373d681c38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/647a6443ec0c49e58d3cdb373d681c38"}]}] Aug 24 07:57:55.017738 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant: tempest-VolumesActionsTest-1050177248 Aug 24 07:57:55.017738 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Id: 647a6443ec0c49e58d3cdb373d681c38 Aug 24 07:57:55.017738 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Name: tempest-VolumesActionsTest-1050177248 Aug 24 07:57:55.017738 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User: tempest-VolumesActionsTest-1050177248-project Aug 24 07:57:55.017738 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Id: default Aug 24 07:57:55.017738 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Name: Default Aug 24 07:57:55.017738 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Id: ed5bde75f6d2477ab2747016ab5c309e Aug 24 07:57:55.017738 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Name: tempest-VolumesActionsTest-1050177248-project Aug 24 07:57:55.017738 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: method: > Aug 24 07:57:55.017738 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: exception: Instance 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 could not be found. Aug 24 07:57:55.017738 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: action_args: {'id': '1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3'} Aug 24 07:57:55.018603 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:57:55.018603 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:57:55.018603 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:57:55.018603 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:57:55.018603 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:57:55.018603 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:57:55.018603 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:57:55.018603 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:57:55.018603 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:57:55.018603 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:57:55.018603 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 could not be found. Aug 24 07:57:55.018603 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:57:55.018603 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:57:55.018603 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:57:55.018603 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:57:55.018603 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:57:55.018603 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:57:55.018603 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:57:55.018603 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:57:55.018603 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:57:55.019861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:57:55.019861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:57:55.019861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:57:55.019861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:57:55.019861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:57:55.019861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:57:55.019861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:57:55.019861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 could not be found. Aug 24 07:57:55.019861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:57:55.019861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:57:55.019861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:57:55.019861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:57:55.019861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:57:55.019861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:57:55.019861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:57:55.019861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:57:55.019861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 could not be found. Aug 24 07:57:55.019861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:57:55.021077 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-111c2346-6351-40cd-beaa-ef08c6ae7693 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] Returning 404 to user: Instance 1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 could not be found. {{(pid=127590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:57:55.021077 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-111c2346-6351-40cd-beaa-ef08c6ae7693 tempest-VolumesActionsTest-1050177248 tempest-VolumesActionsTest-1050177248-project] 10.222.0.72 "GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3" status: 404 len: 111 microversion: 2.1 time: 0.032968 Aug 24 07:57:55.021077 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 153/302] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:54 2022] GET /compute/v2.1/servers/1a74d2b8-2c12-4e4c-867a-8afc7c1cb8b3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:57:55.087917 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-5dbe314e-8b1f-4dbb-9970-3893f918e0c4 req-cabe0a74-16e2-4b0d-8b7b-db2056c3f6e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f31397ec-5acf-4a90-a500-280a47ed1f55", "tag": "8acdda10-43f7-423f-9513-4deb10644221"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:57:55.100198 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-5dbe314e-8b1f-4dbb-9970-3893f918e0c4 req-cabe0a74-16e2-4b0d-8b7b-db2056c3f6e1 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:55.100554 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-5dbe314e-8b1f-4dbb-9970-3893f918e0c4 req-cabe0a74-16e2-4b0d-8b7b-db2056c3f6e1 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:55.101257 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-5dbe314e-8b1f-4dbb-9970-3893f918e0c4 req-cabe0a74-16e2-4b0d-8b7b-db2056c3f6e1 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:55.113047 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-5dbe314e-8b1f-4dbb-9970-3893f918e0c4 req-cabe0a74-16e2-4b0d-8b7b-db2056c3f6e1 service nova] Creating event network-changed:8acdda10-43f7-423f-9513-4deb10644221 for instance f31397ec-5acf-4a90-a500-280a47ed1f55 on hv-cinder-85427 Aug 24 07:57:55.118596 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-5dbe314e-8b1f-4dbb-9970-3893f918e0c4 req-cabe0a74-16e2-4b0d-8b7b-db2056c3f6e1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035020 Aug 24 07:57:55.119243 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 154/303] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:57:55.142801 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-4adea6d3-e752-41f7-8af3-20e6db636351 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:55.143353 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-4adea6d3-e752-41f7-8af3-20e6db636351 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:55.155994 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4adea6d3-e752-41f7-8af3-20e6db636351 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:55.156638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4adea6d3-e752-41f7-8af3-20e6db636351 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:55.157505 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4adea6d3-e752-41f7-8af3-20e6db636351 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:55.159697 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4adea6d3-e752-41f7-8af3-20e6db636351 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:55.160341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4adea6d3-e752-41f7-8af3-20e6db636351 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:55.161056 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4adea6d3-e752-41f7-8af3-20e6db636351 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:55.421707 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-8267e789-f257-4469-91fd-251d3e4f8aeb tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Flavor limits 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:57:55.422129 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-8267e789-f257-4469-91fd-251d3e4f8aeb tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Image limits 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:57:55.422777 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-8267e789-f257-4469-91fd-251d3e4f8aeb tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Flavor pref 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:57:55.423549 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-8267e789-f257-4469-91fd-251d3e4f8aeb tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Image pref 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:57:55.429133 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-8267e789-f257-4469-91fd-251d3e4f8aeb tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:57:55.450610 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8267e789-f257-4469-91fd-251d3e4f8aeb tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:55.451575 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8267e789-f257-4469-91fd-251d3e4f8aeb tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:55.452170 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8267e789-f257-4469-91fd-251d3e4f8aeb tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:55.453120 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8267e789-f257-4469-91fd-251d3e4f8aeb tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:55.453948 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8267e789-f257-4469-91fd-251d3e4f8aeb tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:55.454526 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8267e789-f257-4469-91fd-251d3e4f8aeb tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:55.479779 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.quota [None req-8267e789-f257-4469-91fd-251d3e4f8aeb tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Getting quotas for project 7701e6492dd940df87340ba204be3138. Resources: {'cores', 'instances', 'ram'} {{(pid=127589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:57:55.492004 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.quota [None req-8267e789-f257-4469-91fd-251d3e4f8aeb tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Getting quotas for user 5fe89d8592a44993838fc4acac83f974 and project 7701e6492dd940df87340ba204be3138. Resources: {'cores', 'instances', 'ram'} {{(pid=127589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:57:55.492231 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-4adea6d3-e752-41f7-8af3-20e6db636351 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:55.503788 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-4adea6d3-e752-41f7-8af3-20e6db636351 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:55.505483 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-4adea6d3-e752-41f7-8af3-20e6db636351 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:55.507681 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-8267e789-f257-4469-91fd-251d3e4f8aeb tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Going to run 1 instances... {{(pid=127589) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:57:55.508170 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-4adea6d3-e752-41f7-8af3-20e6db636351 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1744 microversion: 2.20 time: 0.376661 Aug 24 07:57:55.509273 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 155/304] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:55 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1744 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:57:55.510418 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-8267e789-f257-4469-91fd-251d3e4f8aeb tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccdab334-55ce-4ff5-bd97-5a424660c282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:57:55.556249 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-cbabab01-a9f5-4dcc-860c-b50380d6c2d8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:55.556893 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-cbabab01-a9f5-4dcc-860c-b50380d6c2d8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:55.563411 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cbabab01-a9f5-4dcc-860c-b50380d6c2d8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:55.563893 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cbabab01-a9f5-4dcc-860c-b50380d6c2d8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:55.564321 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cbabab01-a9f5-4dcc-860c-b50380d6c2d8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:55.565154 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cbabab01-a9f5-4dcc-860c-b50380d6c2d8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:55.565601 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cbabab01-a9f5-4dcc-860c-b50380d6c2d8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:55.566028 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cbabab01-a9f5-4dcc-860c-b50380d6c2d8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:55.678364 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-8267e789-f257-4469-91fd-251d3e4f8aeb tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.791246 Aug 24 07:57:55.679129 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 150/305] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 24 07:57:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:57:55.711778 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-844e48a3-9f26-4b60-9bd7-e617700635c0 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:55.714186 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-844e48a3-9f26-4b60-9bd7-e617700635c0 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:55.773969 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-cbabab01-a9f5-4dcc-860c-b50380d6c2d8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:55.787417 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-cbabab01-a9f5-4dcc-860c-b50380d6c2d8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1369 microversion: 2.1 time: 0.232497 Aug 24 07:57:55.789098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 156/306] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:55 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1369 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:55.804355 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-844e48a3-9f26-4b60-9bd7-e617700635c0 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe89d8592a44993838fc4acac83f974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7701e6492dd940df87340ba204be3138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:55.813072 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-844e48a3-9f26-4b60-9bd7-e617700635c0 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 200 len: 1215 microversion: 2.1 time: 0.125397 Aug 24 07:57:55.814134 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 151/307] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:55 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 1215 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:56.535745 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-3d286e16-910f-4d08-aa76-01f15724d6d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:56.537039 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-3d286e16-910f-4d08-aa76-01f15724d6d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:56.543570 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3d286e16-910f-4d08-aa76-01f15724d6d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:56.544279 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3d286e16-910f-4d08-aa76-01f15724d6d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:56.545097 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3d286e16-910f-4d08-aa76-01f15724d6d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:56.546032 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3d286e16-910f-4d08-aa76-01f15724d6d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:56.546648 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3d286e16-910f-4d08-aa76-01f15724d6d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:56.547362 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3d286e16-910f-4d08-aa76-01f15724d6d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:56.812452 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-4950d53a-7fee-45b9-8bfc-ef9db15ff807 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:56.813135 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-4950d53a-7fee-45b9-8bfc-ef9db15ff807 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:56.813731 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-3d286e16-910f-4d08-aa76-01f15724d6d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:56.828607 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4950d53a-7fee-45b9-8bfc-ef9db15ff807 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:56.829434 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4950d53a-7fee-45b9-8bfc-ef9db15ff807 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:56.830277 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4950d53a-7fee-45b9-8bfc-ef9db15ff807 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:56.831556 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4950d53a-7fee-45b9-8bfc-ef9db15ff807 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:56.832429 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4950d53a-7fee-45b9-8bfc-ef9db15ff807 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:56.833217 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4950d53a-7fee-45b9-8bfc-ef9db15ff807 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:56.833702 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-3d286e16-910f-4d08-aa76-01f15724d6d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:56.835280 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-3d286e16-910f-4d08-aa76-01f15724d6d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:56.836471 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-3d286e16-910f-4d08-aa76-01f15724d6d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1739 microversion: 2.20 time: 0.305501 Aug 24 07:57:56.837344 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 157/308] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:56 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1739 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:56.845562 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-e740e9bd-ce54-44df-bf50-ef1bf272afc5 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:56.848712 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-e740e9bd-ce54-44df-bf50-ef1bf272afc5 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:56.929945 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-e740e9bd-ce54-44df-bf50-ef1bf272afc5 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe89d8592a44993838fc4acac83f974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7701e6492dd940df87340ba204be3138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:56.945309 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-e740e9bd-ce54-44df-bf50-ef1bf272afc5 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 200 len: 1215 microversion: 2.1 time: 0.106791 Aug 24 07:57:56.946558 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 158/309] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:56 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 1215 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:57.026389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-4950d53a-7fee-45b9-8bfc-ef9db15ff807 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:57.040425 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-4950d53a-7fee-45b9-8bfc-ef9db15ff807 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1369 microversion: 2.1 time: 0.232562 Aug 24 07:57:57.043495 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 152/310] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:56 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1369 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:57.859611 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-fe01ee70-0855-419c-97bc-b2a566005c1c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:57.861635 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-fe01ee70-0855-419c-97bc-b2a566005c1c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:57.870243 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fe01ee70-0855-419c-97bc-b2a566005c1c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:57.871034 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fe01ee70-0855-419c-97bc-b2a566005c1c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:57.871672 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fe01ee70-0855-419c-97bc-b2a566005c1c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:57.872377 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fe01ee70-0855-419c-97bc-b2a566005c1c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:57.872849 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fe01ee70-0855-419c-97bc-b2a566005c1c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:57.873496 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fe01ee70-0855-419c-97bc-b2a566005c1c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:57.973169 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-d934d89e-4fb3-493f-b59f-1e9faaac4e80 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:57.974791 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-d934d89e-4fb3-493f-b59f-1e9faaac4e80 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:57.985523 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d934d89e-4fb3-493f-b59f-1e9faaac4e80 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:57.986488 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d934d89e-4fb3-493f-b59f-1e9faaac4e80 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:57.987159 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d934d89e-4fb3-493f-b59f-1e9faaac4e80 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:57.988295 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d934d89e-4fb3-493f-b59f-1e9faaac4e80 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:57.989028 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d934d89e-4fb3-493f-b59f-1e9faaac4e80 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:57.989750 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d934d89e-4fb3-493f-b59f-1e9faaac4e80 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:58.106773 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-fe01ee70-0855-419c-97bc-b2a566005c1c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:58.112412 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-d934d89e-4fb3-493f-b59f-1e9faaac4e80 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe89d8592a44993838fc4acac83f974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7701e6492dd940df87340ba204be3138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:58.125025 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-d934d89e-4fb3-493f-b59f-1e9faaac4e80 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 200 len: 1219 microversion: 2.1 time: 0.161342 Aug 24 07:57:58.132199 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-fe01ee70-0855-419c-97bc-b2a566005c1c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:58.133925 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-fe01ee70-0855-419c-97bc-b2a566005c1c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:58.137594 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-fe01ee70-0855-419c-97bc-b2a566005c1c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1739 microversion: 2.20 time: 0.282109 Aug 24 07:57:58.137906 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 153/311] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:57 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 1219 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:58.140144 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 159/312] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:57 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1739 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:57:58.149850 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-71969c9c-007d-4e66-bf27-73f72c3ea0dd tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:58.150472 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-71969c9c-007d-4e66-bf27-73f72c3ea0dd tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:58.156581 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-71969c9c-007d-4e66-bf27-73f72c3ea0dd tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:58.157097 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-71969c9c-007d-4e66-bf27-73f72c3ea0dd tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:58.158248 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-71969c9c-007d-4e66-bf27-73f72c3ea0dd tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:58.159932 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-71969c9c-007d-4e66-bf27-73f72c3ea0dd tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:58.160552 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-71969c9c-007d-4e66-bf27-73f72c3ea0dd tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:58.161150 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-71969c9c-007d-4e66-bf27-73f72c3ea0dd tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:58.336836 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-71969c9c-007d-4e66-bf27-73f72c3ea0dd tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:58.340625 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=100 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:58.345945 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-71969c9c-007d-4e66-bf27-73f72c3ea0dd tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1369 microversion: 2.1 time: 0.206929 Aug 24 07:57:58.346727 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 154/313] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:58 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1369 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:59.148639 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-d49beab4-f160-4d62-ad58-ce641d0f353e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:59.149316 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-d49beab4-f160-4d62-ad58-ce641d0f353e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:59.156400 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d49beab4-f160-4d62-ad58-ce641d0f353e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:59.157960 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d49beab4-f160-4d62-ad58-ce641d0f353e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:59.157960 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d49beab4-f160-4d62-ad58-ce641d0f353e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:59.158685 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d49beab4-f160-4d62-ad58-ce641d0f353e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:59.159389 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d49beab4-f160-4d62-ad58-ce641d0f353e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:59.159759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d49beab4-f160-4d62-ad58-ce641d0f353e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:59.172337 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-32ec3629-b107-4ace-a050-50a8aefc51cb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:59.173972 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-32ec3629-b107-4ace-a050-50a8aefc51cb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:59.181350 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-32ec3629-b107-4ace-a050-50a8aefc51cb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:59.182270 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-32ec3629-b107-4ace-a050-50a8aefc51cb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:59.182999 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-32ec3629-b107-4ace-a050-50a8aefc51cb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:59.183822 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-32ec3629-b107-4ace-a050-50a8aefc51cb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:59.184369 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-32ec3629-b107-4ace-a050-50a8aefc51cb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:59.185014 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-32ec3629-b107-4ace-a050-50a8aefc51cb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:59.276550 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-d49beab4-f160-4d62-ad58-ce641d0f353e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe89d8592a44993838fc4acac83f974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7701e6492dd940df87340ba204be3138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:59.287712 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-d49beab4-f160-4d62-ad58-ce641d0f353e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 200 len: 1219 microversion: 2.1 time: 0.144216 Aug 24 07:57:59.302313 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 160/314] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:59 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 1219 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:59.371764 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-32ec3629-b107-4ace-a050-50a8aefc51cb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:59.372878 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-8ff5b630-6a79-402d-aa6e-c2b4582d140c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:59.373597 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-8ff5b630-6a79-402d-aa6e-c2b4582d140c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:59.380777 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8ff5b630-6a79-402d-aa6e-c2b4582d140c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:59.381355 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8ff5b630-6a79-402d-aa6e-c2b4582d140c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:59.381915 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8ff5b630-6a79-402d-aa6e-c2b4582d140c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:59.383282 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8ff5b630-6a79-402d-aa6e-c2b4582d140c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:59.383982 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8ff5b630-6a79-402d-aa6e-c2b4582d140c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:59.384629 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8ff5b630-6a79-402d-aa6e-c2b4582d140c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:59.387375 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-32ec3629-b107-4ace-a050-50a8aefc51cb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:59.389217 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-32ec3629-b107-4ace-a050-50a8aefc51cb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:59.390404 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-32ec3629-b107-4ace-a050-50a8aefc51cb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1739 microversion: 2.20 time: 0.222923 Aug 24 07:57:59.390967 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 155/315] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:57:59 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:57:59.586016 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-8ff5b630-6a79-402d-aa6e-c2b4582d140c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:59.590579 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=100 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:59.599741 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-8ff5b630-6a79-402d-aa6e-c2b4582d140c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1369 microversion: 2.1 time: 0.231097 Aug 24 07:57:59.600510 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 161/316] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:59 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1369 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:00.310227 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-f493a555-d854-4bf7-a1b3-3107657a8544 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:00.310950 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-f493a555-d854-4bf7-a1b3-3107657a8544 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:00.336129 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f493a555-d854-4bf7-a1b3-3107657a8544 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:00.337955 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f493a555-d854-4bf7-a1b3-3107657a8544 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:00.337955 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f493a555-d854-4bf7-a1b3-3107657a8544 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:00.337955 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f493a555-d854-4bf7-a1b3-3107657a8544 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:00.338418 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f493a555-d854-4bf7-a1b3-3107657a8544 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:00.339039 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f493a555-d854-4bf7-a1b3-3107657a8544 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:00.415242 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-f6152076-4287-4866-b247-75bebacc5188 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:00.418881 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-f6152076-4287-4866-b247-75bebacc5188 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:00.420101 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-f493a555-d854-4bf7-a1b3-3107657a8544 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe89d8592a44993838fc4acac83f974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7701e6492dd940df87340ba204be3138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:00.425773 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f6152076-4287-4866-b247-75bebacc5188 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:00.427120 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f6152076-4287-4866-b247-75bebacc5188 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:00.427816 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f6152076-4287-4866-b247-75bebacc5188 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:00.429162 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f6152076-4287-4866-b247-75bebacc5188 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:00.429776 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f6152076-4287-4866-b247-75bebacc5188 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:00.430356 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f6152076-4287-4866-b247-75bebacc5188 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:00.433050 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-f493a555-d854-4bf7-a1b3-3107657a8544 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 200 len: 1219 microversion: 2.1 time: 0.126592 Aug 24 07:58:00.445549 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 156/317] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:00 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 1219 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:00.595703 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-f6152076-4287-4866-b247-75bebacc5188 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:00.605212 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-f6152076-4287-4866-b247-75bebacc5188 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:00.606751 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-f6152076-4287-4866-b247-75bebacc5188 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:00.615676 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-f6152076-4287-4866-b247-75bebacc5188 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1739 microversion: 2.20 time: 0.206425 Aug 24 07:58:00.616813 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 162/318] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:00 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:00.642093 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-c45256a0-dada-4f06-96be-787874caddae tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:00.642736 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-c45256a0-dada-4f06-96be-787874caddae tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:00.652736 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c45256a0-dada-4f06-96be-787874caddae tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:00.653235 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c45256a0-dada-4f06-96be-787874caddae tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:00.653677 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c45256a0-dada-4f06-96be-787874caddae tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:00.654490 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c45256a0-dada-4f06-96be-787874caddae tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:00.654943 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c45256a0-dada-4f06-96be-787874caddae tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:00.655369 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c45256a0-dada-4f06-96be-787874caddae tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:00.821971 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-c45256a0-dada-4f06-96be-787874caddae tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:00.831626 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-c45256a0-dada-4f06-96be-787874caddae tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1369 microversion: 2.1 time: 0.212074 Aug 24 07:58:00.844752 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 157/319] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:00 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1369 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:01.455073 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-9d0247ac-160e-45c9-9623-f228acf13c73 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:01.455933 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-9d0247ac-160e-45c9-9623-f228acf13c73 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:01.462380 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9d0247ac-160e-45c9-9623-f228acf13c73 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:01.463097 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9d0247ac-160e-45c9-9623-f228acf13c73 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:01.463752 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9d0247ac-160e-45c9-9623-f228acf13c73 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:01.464671 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9d0247ac-160e-45c9-9623-f228acf13c73 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:01.465130 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9d0247ac-160e-45c9-9623-f228acf13c73 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:01.465569 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9d0247ac-160e-45c9-9623-f228acf13c73 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:01.541023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9d0247ac-160e-45c9-9623-f228acf13c73 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe89d8592a44993838fc4acac83f974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7701e6492dd940df87340ba204be3138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:01.555955 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-9d0247ac-160e-45c9-9623-f228acf13c73 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 200 len: 1219 microversion: 2.1 time: 0.104666 Aug 24 07:58:01.557402 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 163/320] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:01 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:01.642527 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-c8313d3d-4051-4e4a-8101-4439cdaf39cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:01.643871 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-c8313d3d-4051-4e4a-8101-4439cdaf39cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:01.651788 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c8313d3d-4051-4e4a-8101-4439cdaf39cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:01.652817 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c8313d3d-4051-4e4a-8101-4439cdaf39cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:01.653746 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c8313d3d-4051-4e4a-8101-4439cdaf39cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:01.655010 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c8313d3d-4051-4e4a-8101-4439cdaf39cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:01.655739 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c8313d3d-4051-4e4a-8101-4439cdaf39cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:01.656383 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c8313d3d-4051-4e4a-8101-4439cdaf39cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:01.825694 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-c8313d3d-4051-4e4a-8101-4439cdaf39cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:01.836316 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-c8313d3d-4051-4e4a-8101-4439cdaf39cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:01.838376 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-c8313d3d-4051-4e4a-8101-4439cdaf39cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:01.839822 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-c8313d3d-4051-4e4a-8101-4439cdaf39cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1739 microversion: 2.20 time: 0.202791 Aug 24 07:58:01.840758 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 158/321] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:01 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:01.863350 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-4a1bb57f-3b2f-4dea-87e6-c46302d854b6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:01.864583 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-4a1bb57f-3b2f-4dea-87e6-c46302d854b6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:01.872767 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4a1bb57f-3b2f-4dea-87e6-c46302d854b6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:01.876413 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4a1bb57f-3b2f-4dea-87e6-c46302d854b6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:01.876413 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4a1bb57f-3b2f-4dea-87e6-c46302d854b6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:01.876413 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4a1bb57f-3b2f-4dea-87e6-c46302d854b6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:01.876413 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4a1bb57f-3b2f-4dea-87e6-c46302d854b6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:01.876790 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4a1bb57f-3b2f-4dea-87e6-c46302d854b6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:02.058347 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-4a1bb57f-3b2f-4dea-87e6-c46302d854b6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:02.068384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-4a1bb57f-3b2f-4dea-87e6-c46302d854b6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1369 microversion: 2.1 time: 0.212700 Aug 24 07:58:02.083755 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 164/322] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:01 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1369 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:02.582009 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-d36296c4-6eec-4b0e-990b-6fe3d6513aab tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:02.582900 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-d36296c4-6eec-4b0e-990b-6fe3d6513aab tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:02.589670 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d36296c4-6eec-4b0e-990b-6fe3d6513aab tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:02.590218 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d36296c4-6eec-4b0e-990b-6fe3d6513aab tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:02.590659 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d36296c4-6eec-4b0e-990b-6fe3d6513aab tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:02.591368 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d36296c4-6eec-4b0e-990b-6fe3d6513aab tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:02.591824 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d36296c4-6eec-4b0e-990b-6fe3d6513aab tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:02.592300 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d36296c4-6eec-4b0e-990b-6fe3d6513aab tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:02.664920 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-d36296c4-6eec-4b0e-990b-6fe3d6513aab tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe89d8592a44993838fc4acac83f974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7701e6492dd940df87340ba204be3138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:02.673966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-d36296c4-6eec-4b0e-990b-6fe3d6513aab tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 200 len: 1267 microversion: 2.1 time: 0.096620 Aug 24 07:58:02.687758 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 159/323] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:02 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 1267 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:02.868721 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-7d0c5eed-f134-4532-afca-2cb0c5578bfc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:02.870626 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-7d0c5eed-f134-4532-afca-2cb0c5578bfc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:02.882092 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d0c5eed-f134-4532-afca-2cb0c5578bfc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:02.882592 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d0c5eed-f134-4532-afca-2cb0c5578bfc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:02.883165 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d0c5eed-f134-4532-afca-2cb0c5578bfc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:02.884055 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d0c5eed-f134-4532-afca-2cb0c5578bfc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:02.884505 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d0c5eed-f134-4532-afca-2cb0c5578bfc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:02.884954 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d0c5eed-f134-4532-afca-2cb0c5578bfc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:03.044311 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-7d0c5eed-f134-4532-afca-2cb0c5578bfc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:03.054344 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-7d0c5eed-f134-4532-afca-2cb0c5578bfc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:03.056164 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-7d0c5eed-f134-4532-afca-2cb0c5578bfc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:03.058391 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-7d0c5eed-f134-4532-afca-2cb0c5578bfc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1739 microversion: 2.20 time: 0.195182 Aug 24 07:58:03.058950 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 165/324] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:02 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:03.095055 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-a425bb8e-6b76-44af-a659-817f8b55eddc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:03.095685 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-a425bb8e-6b76-44af-a659-817f8b55eddc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:03.103203 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a425bb8e-6b76-44af-a659-817f8b55eddc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:03.104169 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a425bb8e-6b76-44af-a659-817f8b55eddc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:03.104909 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a425bb8e-6b76-44af-a659-817f8b55eddc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:03.105714 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a425bb8e-6b76-44af-a659-817f8b55eddc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:03.106253 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a425bb8e-6b76-44af-a659-817f8b55eddc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:03.106758 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a425bb8e-6b76-44af-a659-817f8b55eddc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:03.293086 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a425bb8e-6b76-44af-a659-817f8b55eddc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:03.301692 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-a425bb8e-6b76-44af-a659-817f8b55eddc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1369 microversion: 2.1 time: 0.210536 Aug 24 07:58:03.302277 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 160/325] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:03 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1369 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:03.695065 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-c0735306-b058-4b89-994a-0e6c9f67fba0 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:03.695773 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-c0735306-b058-4b89-994a-0e6c9f67fba0 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:03.702171 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c0735306-b058-4b89-994a-0e6c9f67fba0 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:03.702870 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c0735306-b058-4b89-994a-0e6c9f67fba0 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:03.703520 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c0735306-b058-4b89-994a-0e6c9f67fba0 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:03.704346 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c0735306-b058-4b89-994a-0e6c9f67fba0 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:03.705083 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c0735306-b058-4b89-994a-0e6c9f67fba0 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:03.709208 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c0735306-b058-4b89-994a-0e6c9f67fba0 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:03.783385 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-c0735306-b058-4b89-994a-0e6c9f67fba0 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe89d8592a44993838fc4acac83f974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7701e6492dd940df87340ba204be3138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:03.791091 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-c0735306-b058-4b89-994a-0e6c9f67fba0 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 200 len: 1275 microversion: 2.1 time: 0.100478 Aug 24 07:58:03.791651 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 166/326] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:03 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 1275 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:04.083226 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-192ca509-6873-4730-ad0b-a8ff9de49d72 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:04.084585 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-192ca509-6873-4730-ad0b-a8ff9de49d72 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:04.094713 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-192ca509-6873-4730-ad0b-a8ff9de49d72 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:04.095593 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-192ca509-6873-4730-ad0b-a8ff9de49d72 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:04.097119 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-192ca509-6873-4730-ad0b-a8ff9de49d72 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:04.098478 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-192ca509-6873-4730-ad0b-a8ff9de49d72 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:04.099166 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-192ca509-6873-4730-ad0b-a8ff9de49d72 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:04.100618 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-192ca509-6873-4730-ad0b-a8ff9de49d72 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:04.293102 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-192ca509-6873-4730-ad0b-a8ff9de49d72 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:04.302294 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-192ca509-6873-4730-ad0b-a8ff9de49d72 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:04.306814 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-192ca509-6873-4730-ad0b-a8ff9de49d72 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:04.306814 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-192ca509-6873-4730-ad0b-a8ff9de49d72 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1739 microversion: 2.20 time: 0.227569 Aug 24 07:58:04.306814 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 161/327] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:04 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:04.322243 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-2f3aef11-d93b-4098-8c4e-2a7f0ac966f6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:04.323012 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-2f3aef11-d93b-4098-8c4e-2a7f0ac966f6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:04.329544 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2f3aef11-d93b-4098-8c4e-2a7f0ac966f6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:04.333687 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2f3aef11-d93b-4098-8c4e-2a7f0ac966f6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:04.334338 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2f3aef11-d93b-4098-8c4e-2a7f0ac966f6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:04.335352 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2f3aef11-d93b-4098-8c4e-2a7f0ac966f6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:04.335917 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2f3aef11-d93b-4098-8c4e-2a7f0ac966f6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:04.336497 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2f3aef11-d93b-4098-8c4e-2a7f0ac966f6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:04.816619 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b16f4f97-18f1-48a0-9de4-31f03888560e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:04.817685 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-b16f4f97-18f1-48a0-9de4-31f03888560e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:04.827379 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b16f4f97-18f1-48a0-9de4-31f03888560e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:04.829214 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b16f4f97-18f1-48a0-9de4-31f03888560e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:04.830181 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b16f4f97-18f1-48a0-9de4-31f03888560e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:04.831028 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b16f4f97-18f1-48a0-9de4-31f03888560e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:04.831598 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b16f4f97-18f1-48a0-9de4-31f03888560e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:04.832284 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b16f4f97-18f1-48a0-9de4-31f03888560e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:04.850473 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-2f3aef11-d93b-4098-8c4e-2a7f0ac966f6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:04.864635 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-2f3aef11-d93b-4098-8c4e-2a7f0ac966f6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1369 microversion: 2.1 time: 0.546356 Aug 24 07:58:04.881152 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 167/328] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:04 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1369 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:04.899215 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-d0a484e6-709a-45fb-91a4-55ea43510e46 req-b697c4d8-17fa-4c57-a139-bc3986893d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31397ec-5acf-4a90-a500-280a47ed1f55", "name": "network-vif-plugged", "status": "completed", "tag": "8acdda10-43f7-423f-9513-4deb10644221"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:58:04.945357 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-d0a484e6-709a-45fb-91a4-55ea43510e46 req-b697c4d8-17fa-4c57-a139-bc3986893d99 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:04.945357 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-d0a484e6-709a-45fb-91a4-55ea43510e46 req-b697c4d8-17fa-4c57-a139-bc3986893d99 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:04.945357 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-d0a484e6-709a-45fb-91a4-55ea43510e46 req-b697c4d8-17fa-4c57-a139-bc3986893d99 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:04.970814 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-d0a484e6-709a-45fb-91a4-55ea43510e46 req-b697c4d8-17fa-4c57-a139-bc3986893d99 service nova] Creating event network-vif-plugged:8acdda10-43f7-423f-9513-4deb10644221 for instance f31397ec-5acf-4a90-a500-280a47ed1f55 on hv-cinder-85427 Aug 24 07:58:04.982820 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b16f4f97-18f1-48a0-9de4-31f03888560e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe89d8592a44993838fc4acac83f974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7701e6492dd940df87340ba204be3138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:04.983389 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-d0a484e6-709a-45fb-91a4-55ea43510e46 req-b697c4d8-17fa-4c57-a139-bc3986893d99 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087811 Aug 24 07:58:04.985739 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 168/329] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:58:04.998387 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-b16f4f97-18f1-48a0-9de4-31f03888560e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 200 len: 1273 microversion: 2.1 time: 0.186451 Aug 24 07:58:04.999456 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 162/330] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:04 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 1273 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:05.330845 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-8df90dc6-9323-4593-bb14-95b344222473 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:05.334537 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-8df90dc6-9323-4593-bb14-95b344222473 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:05.343407 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8df90dc6-9323-4593-bb14-95b344222473 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:05.345358 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8df90dc6-9323-4593-bb14-95b344222473 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:05.346145 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8df90dc6-9323-4593-bb14-95b344222473 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:05.347031 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8df90dc6-9323-4593-bb14-95b344222473 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:05.347652 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8df90dc6-9323-4593-bb14-95b344222473 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:05.348775 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8df90dc6-9323-4593-bb14-95b344222473 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:05.627750 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-8df90dc6-9323-4593-bb14-95b344222473 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:05.657047 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-8df90dc6-9323-4593-bb14-95b344222473 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:05.657047 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-8df90dc6-9323-4593-bb14-95b344222473 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:05.657047 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-8df90dc6-9323-4593-bb14-95b344222473 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1739 microversion: 2.20 time: 0.317653 Aug 24 07:58:05.657592 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 169/331] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:05 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1739 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:05.897069 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-63770fe6-fb28-43a3-b421-b1f6d2cbf263 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:05.899150 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-63770fe6-fb28-43a3-b421-b1f6d2cbf263 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:05.906214 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=2 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:05.909475 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=8 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:05.909475 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-63770fe6-fb28-43a3-b421-b1f6d2cbf263 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:05.909902 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-63770fe6-fb28-43a3-b421-b1f6d2cbf263 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:05.910417 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-63770fe6-fb28-43a3-b421-b1f6d2cbf263 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:05.911140 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-63770fe6-fb28-43a3-b421-b1f6d2cbf263 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:05.911596 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-63770fe6-fb28-43a3-b421-b1f6d2cbf263 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:05.912244 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-63770fe6-fb28-43a3-b421-b1f6d2cbf263 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:06.029044 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-47c40131-cbfa-4b54-bac5-6e4e9340b9de tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:06.030756 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-47c40131-cbfa-4b54-bac5-6e4e9340b9de tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:06.046072 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-47c40131-cbfa-4b54-bac5-6e4e9340b9de tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:06.048351 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-47c40131-cbfa-4b54-bac5-6e4e9340b9de tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:06.051339 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-47c40131-cbfa-4b54-bac5-6e4e9340b9de tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:06.052106 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-47c40131-cbfa-4b54-bac5-6e4e9340b9de tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:06.058059 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-47c40131-cbfa-4b54-bac5-6e4e9340b9de tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:06.059841 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-47c40131-cbfa-4b54-bac5-6e4e9340b9de tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:06.078439 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-63770fe6-fb28-43a3-b421-b1f6d2cbf263 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:06.086609 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-63770fe6-fb28-43a3-b421-b1f6d2cbf263 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1369 microversion: 2.1 time: 0.194677 Aug 24 07:58:06.103512 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 163/332] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:05 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1369 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:06.432733 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-47c40131-cbfa-4b54-bac5-6e4e9340b9de tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe89d8592a44993838fc4acac83f974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7701e6492dd940df87340ba204be3138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:06.444806 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-47c40131-cbfa-4b54-bac5-6e4e9340b9de tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 200 len: 1315 microversion: 2.1 time: 0.420501 Aug 24 07:58:06.446751 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 170/333] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:06 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:06.670675 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-7563cf82-da7c-43f3-b905-66c73a05e1f9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:06.671391 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-7563cf82-da7c-43f3-b905-66c73a05e1f9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:06.695157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7563cf82-da7c-43f3-b905-66c73a05e1f9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:06.696119 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7563cf82-da7c-43f3-b905-66c73a05e1f9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:06.697523 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7563cf82-da7c-43f3-b905-66c73a05e1f9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:06.699675 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7563cf82-da7c-43f3-b905-66c73a05e1f9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:06.700324 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7563cf82-da7c-43f3-b905-66c73a05e1f9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:06.701815 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7563cf82-da7c-43f3-b905-66c73a05e1f9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:06.924786 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7563cf82-da7c-43f3-b905-66c73a05e1f9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:06.946819 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7563cf82-da7c-43f3-b905-66c73a05e1f9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:06.949021 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7563cf82-da7c-43f3-b905-66c73a05e1f9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:06.950584 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-7563cf82-da7c-43f3-b905-66c73a05e1f9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1739 microversion: 2.20 time: 0.287620 Aug 24 07:58:06.951699 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 164/334] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:06 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1739 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:07.081381 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-6e9e75c6-5574-4113-9db0-ee64490572ea req-8039308f-7a57-41b1-8c74-f6e787616ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8488563b-2a6e-4b80-acb6-ac843a6d6dcb", "tag": "cc4b48dd-3d57-44b0-b35f-9bdf5f6927c4"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:58:07.095054 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=2 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:07.097502 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-6e9e75c6-5574-4113-9db0-ee64490572ea req-8039308f-7a57-41b1-8c74-f6e787616ba2 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:07.098214 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-6e9e75c6-5574-4113-9db0-ee64490572ea req-8039308f-7a57-41b1-8c74-f6e787616ba2 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:07.098820 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-6e9e75c6-5574-4113-9db0-ee64490572ea req-8039308f-7a57-41b1-8c74-f6e787616ba2 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:07.109127 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-a15d4a59-2915-49fa-a660-ba9e086b5cbf tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:07.110047 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-a15d4a59-2915-49fa-a660-ba9e086b5cbf tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:07.121092 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-6e9e75c6-5574-4113-9db0-ee64490572ea req-8039308f-7a57-41b1-8c74-f6e787616ba2 service nova] Creating event network-changed:cc4b48dd-3d57-44b0-b35f-9bdf5f6927c4 for instance 8488563b-2a6e-4b80-acb6-ac843a6d6dcb on hv-cinder-85427 Aug 24 07:58:07.127016 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-6e9e75c6-5574-4113-9db0-ee64490572ea req-8039308f-7a57-41b1-8c74-f6e787616ba2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052011 Aug 24 07:58:07.129296 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 171/335] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:58:07.137211 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a15d4a59-2915-49fa-a660-ba9e086b5cbf tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:07.137211 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a15d4a59-2915-49fa-a660-ba9e086b5cbf tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:07.137211 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a15d4a59-2915-49fa-a660-ba9e086b5cbf tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:07.137211 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a15d4a59-2915-49fa-a660-ba9e086b5cbf tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:07.138120 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a15d4a59-2915-49fa-a660-ba9e086b5cbf tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:07.138120 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a15d4a59-2915-49fa-a660-ba9e086b5cbf tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:07.324794 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a15d4a59-2915-49fa-a660-ba9e086b5cbf tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:07.340852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-a15d4a59-2915-49fa-a660-ba9e086b5cbf tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1369 microversion: 2.1 time: 0.230616 Aug 24 07:58:07.342381 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 165/336] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:07 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1369 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:07.474575 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-9af76366-c433-4d0f-8998-f163c5628636 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:07.476939 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-9af76366-c433-4d0f-8998-f163c5628636 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:07.484372 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9af76366-c433-4d0f-8998-f163c5628636 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:07.485206 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9af76366-c433-4d0f-8998-f163c5628636 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:07.485873 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9af76366-c433-4d0f-8998-f163c5628636 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:07.486840 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9af76366-c433-4d0f-8998-f163c5628636 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:07.488364 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9af76366-c433-4d0f-8998-f163c5628636 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:07.490082 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9af76366-c433-4d0f-8998-f163c5628636 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:07.769991 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9af76366-c433-4d0f-8998-f163c5628636 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe89d8592a44993838fc4acac83f974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7701e6492dd940df87340ba204be3138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:07.771548 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-9af76366-c433-4d0f-8998-f163c5628636 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 200 len: 1315 microversion: 2.1 time: 0.302732 Aug 24 07:58:07.772499 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 172/337] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:07 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:07.974273 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-48cad6f6-3047-4e3d-83bf-2df555956a3c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:07.974867 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-48cad6f6-3047-4e3d-83bf-2df555956a3c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:07.981860 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-48cad6f6-3047-4e3d-83bf-2df555956a3c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:07.982352 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-48cad6f6-3047-4e3d-83bf-2df555956a3c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:07.982793 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-48cad6f6-3047-4e3d-83bf-2df555956a3c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:07.983490 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-48cad6f6-3047-4e3d-83bf-2df555956a3c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:07.983944 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-48cad6f6-3047-4e3d-83bf-2df555956a3c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:07.984372 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-48cad6f6-3047-4e3d-83bf-2df555956a3c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:08.120562 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-48cad6f6-3047-4e3d-83bf-2df555956a3c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:08.129309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-48cad6f6-3047-4e3d-83bf-2df555956a3c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:08.131136 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-48cad6f6-3047-4e3d-83bf-2df555956a3c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:08.132334 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-48cad6f6-3047-4e3d-83bf-2df555956a3c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1739 microversion: 2.20 time: 0.162131 Aug 24 07:58:08.132930 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 166/338] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:07 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:08.357630 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-b64fb7c1-f10c-474b-963d-fdf95ddeb324 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:08.358472 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-b64fb7c1-f10c-474b-963d-fdf95ddeb324 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:08.365391 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b64fb7c1-f10c-474b-963d-fdf95ddeb324 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:08.366166 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b64fb7c1-f10c-474b-963d-fdf95ddeb324 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:08.366786 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b64fb7c1-f10c-474b-963d-fdf95ddeb324 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:08.367769 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b64fb7c1-f10c-474b-963d-fdf95ddeb324 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:08.368402 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b64fb7c1-f10c-474b-963d-fdf95ddeb324 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:08.369014 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b64fb7c1-f10c-474b-963d-fdf95ddeb324 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:08.681748 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-b64fb7c1-f10c-474b-963d-fdf95ddeb324 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:08.695759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-b64fb7c1-f10c-474b-963d-fdf95ddeb324 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1562 microversion: 2.1 time: 0.342449 Aug 24 07:58:08.696971 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 173/339] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:08 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1562 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:08.721390 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-5c2c4208-cd32-4116-b734-4add58da4153 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:08.721900 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-5c2c4208-cd32-4116-b734-4add58da4153 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:08.733099 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c2c4208-cd32-4116-b734-4add58da4153 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:08.734272 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c2c4208-cd32-4116-b734-4add58da4153 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:08.734712 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c2c4208-cd32-4116-b734-4add58da4153 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:08.738007 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c2c4208-cd32-4116-b734-4add58da4153 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:08.738490 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c2c4208-cd32-4116-b734-4add58da4153 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:08.738929 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c2c4208-cd32-4116-b734-4add58da4153 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:08.794927 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-22113db6-0b98-4147-818d-2e1dde487fd5 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:08.795542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-22113db6-0b98-4147-818d-2e1dde487fd5 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:08.803385 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-22113db6-0b98-4147-818d-2e1dde487fd5 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:08.803901 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-22113db6-0b98-4147-818d-2e1dde487fd5 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:08.804332 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-22113db6-0b98-4147-818d-2e1dde487fd5 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:08.805059 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-22113db6-0b98-4147-818d-2e1dde487fd5 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:08.805510 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-22113db6-0b98-4147-818d-2e1dde487fd5 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:08.805928 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-22113db6-0b98-4147-818d-2e1dde487fd5 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:08.875966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-5c2c4208-cd32-4116-b734-4add58da4153 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.158504 Aug 24 07:58:08.879602 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 167/340] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 24 07:58:08 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:58:09.154747 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-22113db6-0b98-4147-818d-2e1dde487fd5 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe89d8592a44993838fc4acac83f974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7701e6492dd940df87340ba204be3138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:09.155476 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-80eb2771-6364-4198-86ca-8e10a3543de4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:09.156117 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-80eb2771-6364-4198-86ca-8e10a3543de4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:09.159932 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:09.164610 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-22113db6-0b98-4147-818d-2e1dde487fd5 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 200 len: 1315 microversion: 2.1 time: 0.374887 Aug 24 07:58:09.168176 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 174/341] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:08 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:09.169432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-80eb2771-6364-4198-86ca-8e10a3543de4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:09.170135 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-80eb2771-6364-4198-86ca-8e10a3543de4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:09.170664 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-80eb2771-6364-4198-86ca-8e10a3543de4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:09.171821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-80eb2771-6364-4198-86ca-8e10a3543de4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:09.172264 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-80eb2771-6364-4198-86ca-8e10a3543de4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:09.172841 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-80eb2771-6364-4198-86ca-8e10a3543de4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:09.436064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-80eb2771-6364-4198-86ca-8e10a3543de4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:09.444265 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-80eb2771-6364-4198-86ca-8e10a3543de4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:09.445928 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-80eb2771-6364-4198-86ca-8e10a3543de4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:09.447088 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-80eb2771-6364-4198-86ca-8e10a3543de4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1739 microversion: 2.20 time: 0.296267 Aug 24 07:58:09.447642 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 168/342] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:09 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1739 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:10.187109 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-e394d725-78b1-4196-8370-5a286dae51d4 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:10.187888 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-e394d725-78b1-4196-8370-5a286dae51d4 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:10.195144 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e394d725-78b1-4196-8370-5a286dae51d4 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:10.195800 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e394d725-78b1-4196-8370-5a286dae51d4 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:10.196237 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e394d725-78b1-4196-8370-5a286dae51d4 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:10.196965 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e394d725-78b1-4196-8370-5a286dae51d4 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:10.197500 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e394d725-78b1-4196-8370-5a286dae51d4 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:10.197917 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e394d725-78b1-4196-8370-5a286dae51d4 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:10.270592 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-3486c1f8-b6d8-459f-9f01-47164449f303 req-c5fd9f0b-f5b2-4d0c-9d5f-ef48eac6dcba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f31397ec-5acf-4a90-a500-280a47ed1f55", "tag": "8acdda10-43f7-423f-9513-4deb10644221"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:58:10.286767 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-3486c1f8-b6d8-459f-9f01-47164449f303 req-c5fd9f0b-f5b2-4d0c-9d5f-ef48eac6dcba service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:10.286767 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-3486c1f8-b6d8-459f-9f01-47164449f303 req-c5fd9f0b-f5b2-4d0c-9d5f-ef48eac6dcba service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:10.286767 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-3486c1f8-b6d8-459f-9f01-47164449f303 req-c5fd9f0b-f5b2-4d0c-9d5f-ef48eac6dcba service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:10.299790 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-3486c1f8-b6d8-459f-9f01-47164449f303 req-c5fd9f0b-f5b2-4d0c-9d5f-ef48eac6dcba service nova] Creating event network-changed:8acdda10-43f7-423f-9513-4deb10644221 for instance f31397ec-5acf-4a90-a500-280a47ed1f55 on hv-cinder-85427 Aug 24 07:58:10.305470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-3486c1f8-b6d8-459f-9f01-47164449f303 req-c5fd9f0b-f5b2-4d0c-9d5f-ef48eac6dcba service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038689 Aug 24 07:58:10.309210 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 169/343] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:58:10.440085 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-e394d725-78b1-4196-8370-5a286dae51d4 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe89d8592a44993838fc4acac83f974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7701e6492dd940df87340ba204be3138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:10.450241 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-e394d725-78b1-4196-8370-5a286dae51d4 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 200 len: 1315 microversion: 2.1 time: 0.268093 Aug 24 07:58:10.463969 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 175/344] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:10 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:10.471207 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-6e6e9126-c9af-4860-a7b0-16ed19b5a2d6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:10.471942 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-6e6e9126-c9af-4860-a7b0-16ed19b5a2d6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:10.480403 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6e6e9126-c9af-4860-a7b0-16ed19b5a2d6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:10.481421 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6e6e9126-c9af-4860-a7b0-16ed19b5a2d6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:10.482212 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6e6e9126-c9af-4860-a7b0-16ed19b5a2d6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:10.483149 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6e6e9126-c9af-4860-a7b0-16ed19b5a2d6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:10.483838 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6e6e9126-c9af-4860-a7b0-16ed19b5a2d6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:10.484488 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6e6e9126-c9af-4860-a7b0-16ed19b5a2d6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:10.758571 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-6e6e9126-c9af-4860-a7b0-16ed19b5a2d6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:10.770395 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-6e6e9126-c9af-4860-a7b0-16ed19b5a2d6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:10.772161 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-6e6e9126-c9af-4860-a7b0-16ed19b5a2d6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:10.773633 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-6e6e9126-c9af-4860-a7b0-16ed19b5a2d6 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1739 microversion: 2.20 time: 0.308003 Aug 24 07:58:10.774757 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 170/345] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:10 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1739 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:11.473222 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-e6baf260-19bc-4162-96fe-185111126248 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:11.473899 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-e6baf260-19bc-4162-96fe-185111126248 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:11.496723 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e6baf260-19bc-4162-96fe-185111126248 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:11.497772 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e6baf260-19bc-4162-96fe-185111126248 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:11.498389 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e6baf260-19bc-4162-96fe-185111126248 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:11.499348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e6baf260-19bc-4162-96fe-185111126248 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:11.499977 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e6baf260-19bc-4162-96fe-185111126248 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:11.501444 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e6baf260-19bc-4162-96fe-185111126248 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:11.714002 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-e6baf260-19bc-4162-96fe-185111126248 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe89d8592a44993838fc4acac83f974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7701e6492dd940df87340ba204be3138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:11.742527 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-e6baf260-19bc-4162-96fe-185111126248 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 200 len: 1315 microversion: 2.1 time: 0.270626 Aug 24 07:58:11.750722 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 176/346] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:11 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:11.800813 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-9c6c5b22-6174-4361-86c6-2b30c67721d1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:11.801422 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-9c6c5b22-6174-4361-86c6-2b30c67721d1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:11.811444 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9c6c5b22-6174-4361-86c6-2b30c67721d1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:11.814148 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9c6c5b22-6174-4361-86c6-2b30c67721d1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:11.815204 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9c6c5b22-6174-4361-86c6-2b30c67721d1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:11.819826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9c6c5b22-6174-4361-86c6-2b30c67721d1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:11.820495 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9c6c5b22-6174-4361-86c6-2b30c67721d1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:11.820957 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9c6c5b22-6174-4361-86c6-2b30c67721d1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:12.057868 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-9c6c5b22-6174-4361-86c6-2b30c67721d1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:12.068695 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-9c6c5b22-6174-4361-86c6-2b30c67721d1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:12.071604 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-9c6c5b22-6174-4361-86c6-2b30c67721d1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:12.073773 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-9c6c5b22-6174-4361-86c6-2b30c67721d1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1739 microversion: 2.20 time: 0.277128 Aug 24 07:58:12.075251 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 171/347] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:11 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1739 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:12.771280 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-9ff4faf6-6ac4-4f0e-aaaf-a45a5edf786f tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:12.773177 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-9ff4faf6-6ac4-4f0e-aaaf-a45a5edf786f tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:12.779749 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9ff4faf6-6ac4-4f0e-aaaf-a45a5edf786f tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:12.780489 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9ff4faf6-6ac4-4f0e-aaaf-a45a5edf786f tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:12.781233 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9ff4faf6-6ac4-4f0e-aaaf-a45a5edf786f tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:12.782219 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9ff4faf6-6ac4-4f0e-aaaf-a45a5edf786f tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:12.783014 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9ff4faf6-6ac4-4f0e-aaaf-a45a5edf786f tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:12.783467 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9ff4faf6-6ac4-4f0e-aaaf-a45a5edf786f tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:13.014972 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9ff4faf6-6ac4-4f0e-aaaf-a45a5edf786f tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe89d8592a44993838fc4acac83f974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7701e6492dd940df87340ba204be3138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:13.023787 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-9ff4faf6-6ac4-4f0e-aaaf-a45a5edf786f tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 200 len: 1315 microversion: 2.1 time: 0.256328 Aug 24 07:58:13.024646 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 177/348] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:12 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:13.096697 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-69614346-b03b-4351-b491-df0ffc27b915 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:13.097996 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-69614346-b03b-4351-b491-df0ffc27b915 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:13.106794 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-69614346-b03b-4351-b491-df0ffc27b915 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:13.107466 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-69614346-b03b-4351-b491-df0ffc27b915 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:13.108100 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-69614346-b03b-4351-b491-df0ffc27b915 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:13.109162 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-69614346-b03b-4351-b491-df0ffc27b915 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:13.109904 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-69614346-b03b-4351-b491-df0ffc27b915 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:13.110500 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-69614346-b03b-4351-b491-df0ffc27b915 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:13.140230 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=100 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:13.308142 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-69614346-b03b-4351-b491-df0ffc27b915 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:13.314371 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-69614346-b03b-4351-b491-df0ffc27b915 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:13.316452 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-69614346-b03b-4351-b491-df0ffc27b915 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:13.317859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-69614346-b03b-4351-b491-df0ffc27b915 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1739 microversion: 2.20 time: 0.225115 Aug 24 07:58:13.318473 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 172/349] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:13 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1739 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:14.045912 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-34e2ec2a-c597-4607-95ff-04491052dea5 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:14.046522 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-34e2ec2a-c597-4607-95ff-04491052dea5 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:14.048544 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:14.057260 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-34e2ec2a-c597-4607-95ff-04491052dea5 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:14.072406 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-34e2ec2a-c597-4607-95ff-04491052dea5 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:14.072406 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-34e2ec2a-c597-4607-95ff-04491052dea5 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:14.072406 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-34e2ec2a-c597-4607-95ff-04491052dea5 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:14.072406 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-34e2ec2a-c597-4607-95ff-04491052dea5 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:14.072879 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-34e2ec2a-c597-4607-95ff-04491052dea5 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:14.225086 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-34e2ec2a-c597-4607-95ff-04491052dea5 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe89d8592a44993838fc4acac83f974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7701e6492dd940df87340ba204be3138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:14.233653 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-34e2ec2a-c597-4607-95ff-04491052dea5 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 200 len: 1315 microversion: 2.1 time: 0.191424 Aug 24 07:58:14.234110 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 178/350] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:14 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:14.341549 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-a4ebfdbf-2c78-481a-9856-9ed665867b12 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:14.342229 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-a4ebfdbf-2c78-481a-9856-9ed665867b12 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:14.349043 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a4ebfdbf-2c78-481a-9856-9ed665867b12 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:14.352702 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a4ebfdbf-2c78-481a-9856-9ed665867b12 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:14.352702 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a4ebfdbf-2c78-481a-9856-9ed665867b12 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:14.352702 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a4ebfdbf-2c78-481a-9856-9ed665867b12 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:14.352702 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a4ebfdbf-2c78-481a-9856-9ed665867b12 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:14.353020 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a4ebfdbf-2c78-481a-9856-9ed665867b12 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:14.502506 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a4ebfdbf-2c78-481a-9856-9ed665867b12 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:14.511142 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a4ebfdbf-2c78-481a-9856-9ed665867b12 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:14.515543 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a4ebfdbf-2c78-481a-9856-9ed665867b12 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:14.515543 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-a4ebfdbf-2c78-481a-9856-9ed665867b12 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1739 microversion: 2.20 time: 0.176342 Aug 24 07:58:14.525016 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 173/351] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:14 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:15.255459 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-522b7afe-fed4-4de7-81f2-3a9cc2ae8980 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:15.256085 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-522b7afe-fed4-4de7-81f2-3a9cc2ae8980 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:15.263014 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-522b7afe-fed4-4de7-81f2-3a9cc2ae8980 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:15.264011 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-522b7afe-fed4-4de7-81f2-3a9cc2ae8980 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:15.264778 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-522b7afe-fed4-4de7-81f2-3a9cc2ae8980 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:15.265727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-522b7afe-fed4-4de7-81f2-3a9cc2ae8980 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:15.266357 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-522b7afe-fed4-4de7-81f2-3a9cc2ae8980 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:15.266788 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-522b7afe-fed4-4de7-81f2-3a9cc2ae8980 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:15.503376 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-522b7afe-fed4-4de7-81f2-3a9cc2ae8980 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe89d8592a44993838fc4acac83f974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7701e6492dd940df87340ba204be3138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:15.506909 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=100 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:15.513250 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-522b7afe-fed4-4de7-81f2-3a9cc2ae8980 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 200 len: 1315 microversion: 2.1 time: 0.261049 Aug 24 07:58:15.514368 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 179/352] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:15 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:15.539256 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-83629792-fe58-4e75-9940-f8b3d20a9f80 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:15.539961 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-83629792-fe58-4e75-9940-f8b3d20a9f80 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:15.546705 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-83629792-fe58-4e75-9940-f8b3d20a9f80 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:15.547192 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-83629792-fe58-4e75-9940-f8b3d20a9f80 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:15.548092 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-83629792-fe58-4e75-9940-f8b3d20a9f80 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:15.548342 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-83629792-fe58-4e75-9940-f8b3d20a9f80 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:15.548907 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-83629792-fe58-4e75-9940-f8b3d20a9f80 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:15.549517 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-83629792-fe58-4e75-9940-f8b3d20a9f80 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:15.743964 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-83629792-fe58-4e75-9940-f8b3d20a9f80 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:15.755852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-83629792-fe58-4e75-9940-f8b3d20a9f80 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:15.758508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-83629792-fe58-4e75-9940-f8b3d20a9f80 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:15.759939 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-83629792-fe58-4e75-9940-f8b3d20a9f80 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1739 microversion: 2.20 time: 0.225262 Aug 24 07:58:15.760757 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 174/353] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:15 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:16.539246 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-a5ed6b68-8aac-429a-bb35-d9f34b6875e1 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:16.539830 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-a5ed6b68-8aac-429a-bb35-d9f34b6875e1 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:16.548158 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a5ed6b68-8aac-429a-bb35-d9f34b6875e1 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:16.549106 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a5ed6b68-8aac-429a-bb35-d9f34b6875e1 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:16.550055 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a5ed6b68-8aac-429a-bb35-d9f34b6875e1 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:16.550791 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a5ed6b68-8aac-429a-bb35-d9f34b6875e1 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:16.551210 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a5ed6b68-8aac-429a-bb35-d9f34b6875e1 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:16.551702 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a5ed6b68-8aac-429a-bb35-d9f34b6875e1 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:16.698273 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-a5ed6b68-8aac-429a-bb35-d9f34b6875e1 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe89d8592a44993838fc4acac83f974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7701e6492dd940df87340ba204be3138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:16.707283 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-a5ed6b68-8aac-429a-bb35-d9f34b6875e1 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 200 len: 1315 microversion: 2.1 time: 0.176256 Aug 24 07:58:16.708001 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 180/354] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:16 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:16.794222 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-cbeede40-9950-4614-ac36-e572baeffa24 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:16.797604 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-cbeede40-9950-4614-ac36-e572baeffa24 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:16.808066 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cbeede40-9950-4614-ac36-e572baeffa24 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:16.808827 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cbeede40-9950-4614-ac36-e572baeffa24 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:16.809414 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cbeede40-9950-4614-ac36-e572baeffa24 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:16.810195 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cbeede40-9950-4614-ac36-e572baeffa24 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:16.810887 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cbeede40-9950-4614-ac36-e572baeffa24 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:16.811441 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cbeede40-9950-4614-ac36-e572baeffa24 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:17.313622 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-cbeede40-9950-4614-ac36-e572baeffa24 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:17.338405 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-cbeede40-9950-4614-ac36-e572baeffa24 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:17.338405 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-cbeede40-9950-4614-ac36-e572baeffa24 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:17.338724 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-cbeede40-9950-4614-ac36-e572baeffa24 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1721 microversion: 2.20 time: 0.553128 Aug 24 07:58:17.349223 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 175/355] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:16 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1721 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:17.732599 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-594f8745-ca60-4b44-93c3-718e1379ec10 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:17.734699 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-594f8745-ca60-4b44-93c3-718e1379ec10 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:17.743451 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-594f8745-ca60-4b44-93c3-718e1379ec10 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:17.744912 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-594f8745-ca60-4b44-93c3-718e1379ec10 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:17.745530 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-594f8745-ca60-4b44-93c3-718e1379ec10 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:17.746446 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-594f8745-ca60-4b44-93c3-718e1379ec10 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:17.747552 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-594f8745-ca60-4b44-93c3-718e1379ec10 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:17.748140 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-594f8745-ca60-4b44-93c3-718e1379ec10 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:17.943605 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-594f8745-ca60-4b44-93c3-718e1379ec10 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe89d8592a44993838fc4acac83f974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7701e6492dd940df87340ba204be3138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:17.953218 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-594f8745-ca60-4b44-93c3-718e1379ec10 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 200 len: 1315 microversion: 2.1 time: 0.228496 Aug 24 07:58:17.953869 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 181/356] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:17 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:18.377331 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-12841654-6aa6-4917-8f04-93939b757015 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:18.378191 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-12841654-6aa6-4917-8f04-93939b757015 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:18.398666 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-12841654-6aa6-4917-8f04-93939b757015 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:18.402820 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-12841654-6aa6-4917-8f04-93939b757015 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:18.403513 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-12841654-6aa6-4917-8f04-93939b757015 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:18.415482 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-12841654-6aa6-4917-8f04-93939b757015 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:18.416185 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-12841654-6aa6-4917-8f04-93939b757015 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:18.416838 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-12841654-6aa6-4917-8f04-93939b757015 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:18.562610 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-12841654-6aa6-4917-8f04-93939b757015 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:18.574818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-12841654-6aa6-4917-8f04-93939b757015 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:18.577577 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-12841654-6aa6-4917-8f04-93939b757015 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:18.579340 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-12841654-6aa6-4917-8f04-93939b757015 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1721 microversion: 2.20 time: 0.208460 Aug 24 07:58:18.580120 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 176/357] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:18 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:18.778349 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-fa9c1127-5023-430a-b97f-8c34653e9a2a req-695b2040-d894-463c-9b22-732a42457b06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8488563b-2a6e-4b80-acb6-ac843a6d6dcb", "name": "network-vif-plugged", "status": "completed", "tag": "cc4b48dd-3d57-44b0-b35f-9bdf5f6927c4"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:58:18.792128 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-fa9c1127-5023-430a-b97f-8c34653e9a2a req-695b2040-d894-463c-9b22-732a42457b06 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:18.792606 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-fa9c1127-5023-430a-b97f-8c34653e9a2a req-695b2040-d894-463c-9b22-732a42457b06 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:18.793073 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-fa9c1127-5023-430a-b97f-8c34653e9a2a req-695b2040-d894-463c-9b22-732a42457b06 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:18.807725 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-fa9c1127-5023-430a-b97f-8c34653e9a2a req-695b2040-d894-463c-9b22-732a42457b06 service nova] Creating event network-vif-plugged:cc4b48dd-3d57-44b0-b35f-9bdf5f6927c4 for instance 8488563b-2a6e-4b80-acb6-ac843a6d6dcb on hv-cinder-85427 Aug 24 07:58:18.813218 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-fa9c1127-5023-430a-b97f-8c34653e9a2a req-695b2040-d894-463c-9b22-732a42457b06 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038544 Aug 24 07:58:18.814186 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 182/358] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:58:18.983062 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-ef4efe1d-644d-49fd-a306-b9cd6b327c58 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:18.984635 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-ef4efe1d-644d-49fd-a306-b9cd6b327c58 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:19.000469 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ef4efe1d-644d-49fd-a306-b9cd6b327c58 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:19.001736 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ef4efe1d-644d-49fd-a306-b9cd6b327c58 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:19.002816 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ef4efe1d-644d-49fd-a306-b9cd6b327c58 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:19.005067 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ef4efe1d-644d-49fd-a306-b9cd6b327c58 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:19.006569 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ef4efe1d-644d-49fd-a306-b9cd6b327c58 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:19.007713 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ef4efe1d-644d-49fd-a306-b9cd6b327c58 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:19.202196 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-ef4efe1d-644d-49fd-a306-b9cd6b327c58 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe89d8592a44993838fc4acac83f974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7701e6492dd940df87340ba204be3138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:19.211573 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-ef4efe1d-644d-49fd-a306-b9cd6b327c58 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 200 len: 1315 microversion: 2.1 time: 0.239254 Aug 24 07:58:19.212144 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 177/359] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:18 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:19.605939 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-919e8f13-d73d-4ef3-b062-b934cbca9c0b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:19.611884 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-919e8f13-d73d-4ef3-b062-b934cbca9c0b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:19.621025 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-919e8f13-d73d-4ef3-b062-b934cbca9c0b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:19.622352 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-919e8f13-d73d-4ef3-b062-b934cbca9c0b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:19.622795 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-919e8f13-d73d-4ef3-b062-b934cbca9c0b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:19.624608 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-919e8f13-d73d-4ef3-b062-b934cbca9c0b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:19.625292 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-919e8f13-d73d-4ef3-b062-b934cbca9c0b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:19.625902 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-919e8f13-d73d-4ef3-b062-b934cbca9c0b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:20.139077 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-919e8f13-d73d-4ef3-b062-b934cbca9c0b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:20.149166 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-919e8f13-d73d-4ef3-b062-b934cbca9c0b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:20.153041 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-919e8f13-d73d-4ef3-b062-b934cbca9c0b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:20.161193 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-919e8f13-d73d-4ef3-b062-b934cbca9c0b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1721 microversion: 2.20 time: 0.558518 Aug 24 07:58:20.161799 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 183/360] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:19 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1721 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:20.234072 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-78e4bf74-9d50-424d-9659-e97f40b50808 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:20.235533 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-78e4bf74-9d50-424d-9659-e97f40b50808 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:20.243192 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-78e4bf74-9d50-424d-9659-e97f40b50808 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:20.249352 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-78e4bf74-9d50-424d-9659-e97f40b50808 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:20.249352 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-78e4bf74-9d50-424d-9659-e97f40b50808 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:20.249352 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-78e4bf74-9d50-424d-9659-e97f40b50808 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:20.249352 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-78e4bf74-9d50-424d-9659-e97f40b50808 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:20.249714 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-78e4bf74-9d50-424d-9659-e97f40b50808 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:20.426876 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-78e4bf74-9d50-424d-9659-e97f40b50808 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe89d8592a44993838fc4acac83f974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7701e6492dd940df87340ba204be3138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:20.434960 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-78e4bf74-9d50-424d-9659-e97f40b50808 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 200 len: 1315 microversion: 2.1 time: 0.205538 Aug 24 07:58:20.436723 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 178/361] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:20 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:20.832209 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-0c4939ce-a07e-4c9a-87df-95472b589f22 req-5894d71e-a294-4292-8df7-a3e66d3b6fee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a266e179-03cc-40b3-902d-aab680174711", "name": "network-vif-unplugged", "status": "completed", "tag": "45373581-1bd1-4a1b-aff0-a6e9993cd6b9"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:58:20.843230 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-0c4939ce-a07e-4c9a-87df-95472b589f22 req-5894d71e-a294-4292-8df7-a3e66d3b6fee service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:20.843706 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-0c4939ce-a07e-4c9a-87df-95472b589f22 req-5894d71e-a294-4292-8df7-a3e66d3b6fee service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:20.844308 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-0c4939ce-a07e-4c9a-87df-95472b589f22 req-5894d71e-a294-4292-8df7-a3e66d3b6fee service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:20.856040 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-0c4939ce-a07e-4c9a-87df-95472b589f22 req-5894d71e-a294-4292-8df7-a3e66d3b6fee service nova] Creating event network-vif-unplugged:45373581-1bd1-4a1b-aff0-a6e9993cd6b9 for instance a266e179-03cc-40b3-902d-aab680174711 on hv-cinder-85427 Aug 24 07:58:20.861421 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-0c4939ce-a07e-4c9a-87df-95472b589f22 req-5894d71e-a294-4292-8df7-a3e66d3b6fee service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033274 Aug 24 07:58:20.862307 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 184/362] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:58:21.186736 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-659700b9-d5da-41c7-a039-a77f9024856c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:21.187586 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-659700b9-d5da-41c7-a039-a77f9024856c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:21.196986 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-659700b9-d5da-41c7-a039-a77f9024856c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:21.197826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-659700b9-d5da-41c7-a039-a77f9024856c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:21.200988 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-659700b9-d5da-41c7-a039-a77f9024856c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:21.200988 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-659700b9-d5da-41c7-a039-a77f9024856c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:21.200988 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-659700b9-d5da-41c7-a039-a77f9024856c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:21.201510 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-659700b9-d5da-41c7-a039-a77f9024856c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:21.401764 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-659700b9-d5da-41c7-a039-a77f9024856c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:21.413574 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-659700b9-d5da-41c7-a039-a77f9024856c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:21.420179 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-659700b9-d5da-41c7-a039-a77f9024856c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:21.422029 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-659700b9-d5da-41c7-a039-a77f9024856c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1724 microversion: 2.20 time: 0.240136 Aug 24 07:58:21.423100 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 179/363] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:21 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:21.454655 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-7e01f7f6-ceaa-46c9-9fa4-c6cbacd5398d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "431ca80f-1150-4d08-aa85-f6666279d59f"}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:58:21.458033 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-7e01f7f6-ceaa-46c9-9fa4-c6cbacd5398d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:21.458198 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-cccf5bca-9a9a-4521-88c6-e0343330b47a tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:21.458657 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-cccf5bca-9a9a-4521-88c6-e0343330b47a tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:21.466740 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7e01f7f6-ceaa-46c9-9fa4-c6cbacd5398d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:21.467907 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7e01f7f6-ceaa-46c9-9fa4-c6cbacd5398d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:21.469062 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7e01f7f6-ceaa-46c9-9fa4-c6cbacd5398d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:21.470693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7e01f7f6-ceaa-46c9-9fa4-c6cbacd5398d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:21.476143 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7e01f7f6-ceaa-46c9-9fa4-c6cbacd5398d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:21.476143 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7e01f7f6-ceaa-46c9-9fa4-c6cbacd5398d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:21.480509 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cccf5bca-9a9a-4521-88c6-e0343330b47a tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:21.481314 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cccf5bca-9a9a-4521-88c6-e0343330b47a tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:21.482114 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cccf5bca-9a9a-4521-88c6-e0343330b47a tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:21.482853 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cccf5bca-9a9a-4521-88c6-e0343330b47a tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:21.486777 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cccf5bca-9a9a-4521-88c6-e0343330b47a tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:21.489376 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cccf5bca-9a9a-4521-88c6-e0343330b47a tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:21.744818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-cccf5bca-9a9a-4521-88c6-e0343330b47a tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe89d8592a44993838fc4acac83f974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7701e6492dd940df87340ba204be3138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:21.758990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-cccf5bca-9a9a-4521-88c6-e0343330b47a tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 200 len: 1315 microversion: 2.1 time: 0.304234 Aug 24 07:58:21.760630 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 180/364] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:21 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:22.675342 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-7e01f7f6-ceaa-46c9-9fa4-c6cbacd5398d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "POST /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.227287 Aug 24 07:58:22.676276 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 185/365] 10.222.0.72 () {62 vars in 1364 bytes} [Wed Aug 24 07:58:21 2022] POST /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711/os-volume_attachments => generated 188 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:58:22.792854 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-259ce032-180c-4ef0-a773-77838b1e76bb tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:22.794231 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-259ce032-180c-4ef0-a773-77838b1e76bb tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:22.802393 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-259ce032-180c-4ef0-a773-77838b1e76bb tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:22.803085 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-259ce032-180c-4ef0-a773-77838b1e76bb tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:22.803594 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-259ce032-180c-4ef0-a773-77838b1e76bb tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:22.804351 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-259ce032-180c-4ef0-a773-77838b1e76bb tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:22.804846 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-259ce032-180c-4ef0-a773-77838b1e76bb tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:22.805482 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-259ce032-180c-4ef0-a773-77838b1e76bb tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:22.824196 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-db2a47a9-9696-4532-9092-49dec1c204eb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:58:22.826036 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-db2a47a9-9696-4532-9092-49dec1c204eb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:22.838667 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-db2a47a9-9696-4532-9092-49dec1c204eb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:22.839844 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-db2a47a9-9696-4532-9092-49dec1c204eb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:22.840834 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-db2a47a9-9696-4532-9092-49dec1c204eb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:22.841851 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-db2a47a9-9696-4532-9092-49dec1c204eb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:22.842577 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-db2a47a9-9696-4532-9092-49dec1c204eb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:22.843118 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-db2a47a9-9696-4532-9092-49dec1c204eb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:22.912890 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-db2a47a9-9696-4532-9092-49dec1c204eb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127590) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 07:58:22.958388 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-259ce032-180c-4ef0-a773-77838b1e76bb tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe89d8592a44993838fc4acac83f974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7701e6492dd940df87340ba204be3138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:22.966986 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-259ce032-180c-4ef0-a773-77838b1e76bb tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 200 len: 1465 microversion: 2.1 time: 0.179174 Aug 24 07:58:22.968275 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 181/366] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:22 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 1465 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:23.027414 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-fefd3755-414d-4721-85cc-70304c8e6b3c tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:23.029075 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-fefd3755-414d-4721-85cc-70304c8e6b3c tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:23.037623 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fefd3755-414d-4721-85cc-70304c8e6b3c tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:23.038955 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fefd3755-414d-4721-85cc-70304c8e6b3c tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:23.039599 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fefd3755-414d-4721-85cc-70304c8e6b3c tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:23.040428 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fefd3755-414d-4721-85cc-70304c8e6b3c tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:23.041099 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fefd3755-414d-4721-85cc-70304c8e6b3c tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:23.041708 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fefd3755-414d-4721-85cc-70304c8e6b3c tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:23.072204 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-fefd3755-414d-4721-85cc-70304c8e6b3c tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Going to try to terminate instance {{(pid=127589) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:58:23.198022 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-db2a47a9-9696-4532-9092-49dec1c204eb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "POST /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711/action" status: 202 len: 0 microversion: 2.20 time: 0.380057 Aug 24 07:58:23.198646 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 186/367] 10.222.0.72 () {62 vars in 1319 bytes} [Wed Aug 24 07:58:22 2022] POST /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 07:58:23.207778 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-b57f13ac-84c0-4457-8df8-3ea950013e46 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:23.208358 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-b57f13ac-84c0-4457-8df8-3ea950013e46 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:23.215827 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b57f13ac-84c0-4457-8df8-3ea950013e46 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:23.216420 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b57f13ac-84c0-4457-8df8-3ea950013e46 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:23.217079 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b57f13ac-84c0-4457-8df8-3ea950013e46 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:23.217995 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b57f13ac-84c0-4457-8df8-3ea950013e46 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:23.218469 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b57f13ac-84c0-4457-8df8-3ea950013e46 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:23.218915 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b57f13ac-84c0-4457-8df8-3ea950013e46 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:23.408453 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-fefd3755-414d-4721-85cc-70304c8e6b3c tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "DELETE /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 204 len: 0 microversion: 2.1 time: 0.385409 Aug 24 07:58:23.409191 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 182/368] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 24 07:58:23 2022] DELETE /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:58:23.419887 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-4bd372dd-f1f9-4582-9d9a-eb529d77b6d7 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:23.421353 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-4bd372dd-f1f9-4582-9d9a-eb529d77b6d7 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:23.430439 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4bd372dd-f1f9-4582-9d9a-eb529d77b6d7 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:23.434283 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4bd372dd-f1f9-4582-9d9a-eb529d77b6d7 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:23.434897 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4bd372dd-f1f9-4582-9d9a-eb529d77b6d7 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:23.439856 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4bd372dd-f1f9-4582-9d9a-eb529d77b6d7 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:23.440436 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4bd372dd-f1f9-4582-9d9a-eb529d77b6d7 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:23.441273 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4bd372dd-f1f9-4582-9d9a-eb529d77b6d7 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:23.441719 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-b57f13ac-84c0-4457-8df8-3ea950013e46 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:23.451591 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-b57f13ac-84c0-4457-8df8-3ea950013e46 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:23.453420 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-b57f13ac-84c0-4457-8df8-3ea950013e46 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:23.454774 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-b57f13ac-84c0-4457-8df8-3ea950013e46 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1750 microversion: 2.20 time: 0.251157 Aug 24 07:58:23.456327 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 187/369] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:23 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1750 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:58:23.630412 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-4bd372dd-f1f9-4582-9d9a-eb529d77b6d7 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe89d8592a44993838fc4acac83f974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7701e6492dd940df87340ba204be3138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:23.640521 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-4bd372dd-f1f9-4582-9d9a-eb529d77b6d7 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 200 len: 1471 microversion: 2.1 time: 0.225037 Aug 24 07:58:23.641217 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 183/370] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:23 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 1471 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:24.481548 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-bc716f35-4a1b-4754-80c1-d9a881ab42cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:24.482364 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-bc716f35-4a1b-4754-80c1-d9a881ab42cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:24.488711 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bc716f35-4a1b-4754-80c1-d9a881ab42cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:24.489198 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bc716f35-4a1b-4754-80c1-d9a881ab42cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:24.489640 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bc716f35-4a1b-4754-80c1-d9a881ab42cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:24.490534 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bc716f35-4a1b-4754-80c1-d9a881ab42cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:24.491047 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bc716f35-4a1b-4754-80c1-d9a881ab42cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:24.492263 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bc716f35-4a1b-4754-80c1-d9a881ab42cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:24.663074 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-2c21631d-12f8-44b8-89b3-84ea0fe97cde tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:24.666462 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-bc716f35-4a1b-4754-80c1-d9a881ab42cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:24.670382 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-2c21631d-12f8-44b8-89b3-84ea0fe97cde tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:24.677011 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2c21631d-12f8-44b8-89b3-84ea0fe97cde tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:24.677514 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2c21631d-12f8-44b8-89b3-84ea0fe97cde tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:24.677961 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2c21631d-12f8-44b8-89b3-84ea0fe97cde tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:24.678259 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-bc716f35-4a1b-4754-80c1-d9a881ab42cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:24.678685 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2c21631d-12f8-44b8-89b3-84ea0fe97cde tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:24.679143 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2c21631d-12f8-44b8-89b3-84ea0fe97cde tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:24.679574 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2c21631d-12f8-44b8-89b3-84ea0fe97cde tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:24.680803 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-bc716f35-4a1b-4754-80c1-d9a881ab42cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:24.682894 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-bc716f35-4a1b-4754-80c1-d9a881ab42cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1750 microversion: 2.20 time: 0.204729 Aug 24 07:58:24.696686 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 188/371] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:24 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1750 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:24.871469 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-2c21631d-12f8-44b8-89b3-84ea0fe97cde tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe89d8592a44993838fc4acac83f974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7701e6492dd940df87340ba204be3138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:24.881441 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-2c21631d-12f8-44b8-89b3-84ea0fe97cde tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 200 len: 1471 microversion: 2.1 time: 0.222426 Aug 24 07:58:24.892829 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 184/372] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:24 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 1471 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:25.707284 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-a7e0e33b-d37a-46a0-9b0b-59536a3119c0 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:25.707841 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-a7e0e33b-d37a-46a0-9b0b-59536a3119c0 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:25.715889 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a7e0e33b-d37a-46a0-9b0b-59536a3119c0 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:25.716744 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a7e0e33b-d37a-46a0-9b0b-59536a3119c0 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:25.717359 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a7e0e33b-d37a-46a0-9b0b-59536a3119c0 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:25.718243 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a7e0e33b-d37a-46a0-9b0b-59536a3119c0 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:25.718753 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a7e0e33b-d37a-46a0-9b0b-59536a3119c0 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:25.719294 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a7e0e33b-d37a-46a0-9b0b-59536a3119c0 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:25.861358 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-a7e0e33b-d37a-46a0-9b0b-59536a3119c0 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:25.870213 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-a7e0e33b-d37a-46a0-9b0b-59536a3119c0 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:25.871833 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-a7e0e33b-d37a-46a0-9b0b-59536a3119c0 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:25.873086 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-a7e0e33b-d37a-46a0-9b0b-59536a3119c0 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1750 microversion: 2.20 time: 0.170116 Aug 24 07:58:25.873719 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 189/373] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:25 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1750 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:25.903338 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b5986151-2709-4d29-9fb3-bba709446e2f tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:25.903962 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-b5986151-2709-4d29-9fb3-bba709446e2f tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:25.911193 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b5986151-2709-4d29-9fb3-bba709446e2f tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:25.911684 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b5986151-2709-4d29-9fb3-bba709446e2f tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:25.912168 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b5986151-2709-4d29-9fb3-bba709446e2f tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:25.912948 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b5986151-2709-4d29-9fb3-bba709446e2f tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:25.913908 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b5986151-2709-4d29-9fb3-bba709446e2f tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:25.914340 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b5986151-2709-4d29-9fb3-bba709446e2f tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:26.087947 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b5986151-2709-4d29-9fb3-bba709446e2f tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe89d8592a44993838fc4acac83f974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7701e6492dd940df87340ba204be3138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:26.096086 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-b5986151-2709-4d29-9fb3-bba709446e2f tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 200 len: 1471 microversion: 2.1 time: 0.196547 Aug 24 07:58:26.096877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 185/374] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:25 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 1471 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:26.898538 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-443e30bc-ba8b-4dab-bd8d-96286ed2dd57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:26.899840 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-443e30bc-ba8b-4dab-bd8d-96286ed2dd57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:26.906005 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-443e30bc-ba8b-4dab-bd8d-96286ed2dd57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:26.906786 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-443e30bc-ba8b-4dab-bd8d-96286ed2dd57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:26.907322 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-443e30bc-ba8b-4dab-bd8d-96286ed2dd57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:26.908552 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-443e30bc-ba8b-4dab-bd8d-96286ed2dd57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:26.909035 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-443e30bc-ba8b-4dab-bd8d-96286ed2dd57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:26.909466 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-443e30bc-ba8b-4dab-bd8d-96286ed2dd57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:27.063489 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-443e30bc-ba8b-4dab-bd8d-96286ed2dd57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:27.073289 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-443e30bc-ba8b-4dab-bd8d-96286ed2dd57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:27.074972 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-443e30bc-ba8b-4dab-bd8d-96286ed2dd57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:27.076200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-443e30bc-ba8b-4dab-bd8d-96286ed2dd57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1750 microversion: 2.20 time: 0.182653 Aug 24 07:58:27.076951 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 190/375] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:26 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1750 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:27.117990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-46fdd516-2dd5-49df-962d-cc0e71bfa020 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:27.119384 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-46fdd516-2dd5-49df-962d-cc0e71bfa020 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:27.126887 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-46fdd516-2dd5-49df-962d-cc0e71bfa020 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:27.127706 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-46fdd516-2dd5-49df-962d-cc0e71bfa020 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:27.128147 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-46fdd516-2dd5-49df-962d-cc0e71bfa020 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:27.129209 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-46fdd516-2dd5-49df-962d-cc0e71bfa020 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:27.129679 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-46fdd516-2dd5-49df-962d-cc0e71bfa020 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:27.130111 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-46fdd516-2dd5-49df-962d-cc0e71bfa020 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:27.271498 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-46fdd516-2dd5-49df-962d-cc0e71bfa020 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe89d8592a44993838fc4acac83f974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7701e6492dd940df87340ba204be3138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:27.279995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-46fdd516-2dd5-49df-962d-cc0e71bfa020 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 200 len: 1471 microversion: 2.1 time: 0.166253 Aug 24 07:58:27.280893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 186/376] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:27 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 1471 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:27.868457 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-a0e7542c-95ef-4981-a265-1903ab3d1259 req-353288dc-4ad8-4537-af12-16752df1f33a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8488563b-2a6e-4b80-acb6-ac843a6d6dcb", "name": "network-vif-deleted", "tag": "cc4b48dd-3d57-44b0-b35f-9bdf5f6927c4"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:58:27.896362 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-a0e7542c-95ef-4981-a265-1903ab3d1259 req-353288dc-4ad8-4537-af12-16752df1f33a service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:27.899973 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-a0e7542c-95ef-4981-a265-1903ab3d1259 req-353288dc-4ad8-4537-af12-16752df1f33a service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:27.900561 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-a0e7542c-95ef-4981-a265-1903ab3d1259 req-353288dc-4ad8-4537-af12-16752df1f33a service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:27.926668 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-a0e7542c-95ef-4981-a265-1903ab3d1259 req-353288dc-4ad8-4537-af12-16752df1f33a service nova] Creating event network-vif-deleted:cc4b48dd-3d57-44b0-b35f-9bdf5f6927c4 for instance 8488563b-2a6e-4b80-acb6-ac843a6d6dcb on hv-cinder-85427 Aug 24 07:58:27.932688 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-a0e7542c-95ef-4981-a265-1903ab3d1259 req-353288dc-4ad8-4537-af12-16752df1f33a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068592 Aug 24 07:58:27.934144 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 191/377] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:58:28.107200 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-efec38dd-8f13-44e1-b200-836cdab4ac57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:28.107818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-efec38dd-8f13-44e1-b200-836cdab4ac57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:28.118421 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-efec38dd-8f13-44e1-b200-836cdab4ac57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:28.119790 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-efec38dd-8f13-44e1-b200-836cdab4ac57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:28.120472 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-efec38dd-8f13-44e1-b200-836cdab4ac57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:28.121454 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-efec38dd-8f13-44e1-b200-836cdab4ac57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:28.122144 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-efec38dd-8f13-44e1-b200-836cdab4ac57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:28.122674 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-efec38dd-8f13-44e1-b200-836cdab4ac57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:28.147807 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:28.302296 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-23132626-85d4-4c37-b592-3c132e4d9d1e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:28.302995 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-23132626-85d4-4c37-b592-3c132e4d9d1e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:28.311604 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-23132626-85d4-4c37-b592-3c132e4d9d1e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:28.312390 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-23132626-85d4-4c37-b592-3c132e4d9d1e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:28.312507 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-efec38dd-8f13-44e1-b200-836cdab4ac57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:28.313387 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-23132626-85d4-4c37-b592-3c132e4d9d1e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:28.314320 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-23132626-85d4-4c37-b592-3c132e4d9d1e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:28.314992 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-23132626-85d4-4c37-b592-3c132e4d9d1e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:28.315631 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-23132626-85d4-4c37-b592-3c132e4d9d1e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:28.322051 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-efec38dd-8f13-44e1-b200-836cdab4ac57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:28.323764 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-efec38dd-8f13-44e1-b200-836cdab4ac57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:28.324998 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-efec38dd-8f13-44e1-b200-836cdab4ac57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1750 microversion: 2.20 time: 0.221659 Aug 24 07:58:28.325554 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 187/378] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:28 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1750 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:28.352251 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-23132626-85d4-4c37-b592-3c132e4d9d1e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:28.352874 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-23132626-85d4-4c37-b592-3c132e4d9d1e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:28.353535 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-23132626-85d4-4c37-b592-3c132e4d9d1e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:28.354046 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.objects.instance [None req-23132626-85d4-4c37-b592-3c132e4d9d1e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lazy-loading 'fault' on Instance uuid 8488563b-2a6e-4b80-acb6-ac843a6d6dcb {{(pid=127590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:58:28.409452 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-23132626-85d4-4c37-b592-3c132e4d9d1e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe89d8592a44993838fc4acac83f974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7701e6492dd940df87340ba204be3138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:28.418587 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-23132626-85d4-4c37-b592-3c132e4d9d1e tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 200 len: 1305 microversion: 2.1 time: 0.120353 Aug 24 07:58:28.423565 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 192/379] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:28 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 1305 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:29.352502 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-bee18a29-20ee-4df0-94c2-755155ab63c8 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:29.353093 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-bee18a29-20ee-4df0-94c2-755155ab63c8 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:29.360271 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bee18a29-20ee-4df0-94c2-755155ab63c8 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:29.360791 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bee18a29-20ee-4df0-94c2-755155ab63c8 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:29.361275 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bee18a29-20ee-4df0-94c2-755155ab63c8 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:29.362327 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bee18a29-20ee-4df0-94c2-755155ab63c8 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:29.362876 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bee18a29-20ee-4df0-94c2-755155ab63c8 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:29.363639 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bee18a29-20ee-4df0-94c2-755155ab63c8 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:29.444138 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-c78c026b-f56c-4b8a-8879-2e9b24018ca1 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:29.445900 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-c78c026b-f56c-4b8a-8879-2e9b24018ca1 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] [instance: 8488563b-2a6e-4b80-acb6-ac843a6d6dcb] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:29.452888 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c78c026b-f56c-4b8a-8879-2e9b24018ca1 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:29.453640 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c78c026b-f56c-4b8a-8879-2e9b24018ca1 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:29.454386 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c78c026b-f56c-4b8a-8879-2e9b24018ca1 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:29.455248 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c78c026b-f56c-4b8a-8879-2e9b24018ca1 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:29.455858 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c78c026b-f56c-4b8a-8879-2e9b24018ca1 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:29.456436 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c78c026b-f56c-4b8a-8879-2e9b24018ca1 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:29.473293 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.wsgi [None req-c78c026b-f56c-4b8a-8879-2e9b24018ca1 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] HTTP exception thrown: Instance 8488563b-2a6e-4b80-acb6-ac843a6d6dcb could not be found. Aug 24 07:58:29.475341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-c78c026b-f56c-4b8a-8879-2e9b24018ca1 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Request method failure captured: Aug 24 07:58:29.475341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: request: GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb HTTP/1.1 Aug 24 07:58:29.475341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept: application/json Aug 24 07:58:29.475341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept-Encoding: identity Aug 24 07:58:29.475341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Connection: close Aug 24 07:58:29.475341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Length: 0 Aug 24 07:58:29.475341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Type: application/json Aug 24 07:58:29.475341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Host: 10.222.0.72 Aug 24 07:58:29.475341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Openstack-System-Scope: None Aug 24 07:58:29.475341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: User-Agent: python-urllib3/1.26.11 Aug 24 07:58:29.475341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Auth-Token: gAAAAABjBdn_ocq0RLAoPtZ0JDixUsJyIU__upvOubDQgbXXAS5w6Kq_LbfqBKFSBwTxVkW9qEcbozP0M7CESV0trk-aJJSKf_v7-5mlmgG2LjBbK75ZvaKQaYLGac4rfTo3Haq-n9fKiBatT-U9D-uVi1PaYjRUfpHbb5AXUcEQxJEsOg-4S-o Aug 24 07:58:29.475341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Id: None Aug 24 07:58:29.475341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Name: None Aug 24 07:58:29.475341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Identity-Status: Confirmed Aug 24 07:58:29.475341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Is-Admin-Project: True Aug 24 07:58:29.475341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Id: default Aug 24 07:58:29.475341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Name: Default Aug 24 07:58:29.475341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Id: 7701e6492dd940df87340ba204be3138 Aug 24 07:58:29.475341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Name: tempest-VolumesNegativeTest-1029917363 Aug 24 07:58:29.475341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Role: reader,member Aug 24 07:58:29.475341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Roles: reader,member Aug 24 07:58:29.476667 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7701e6492dd940df87340ba204be3138"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7701e6492dd940df87340ba204be3138"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7701e6492dd940df87340ba204be3138"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7701e6492dd940df87340ba204be3138"}]}] Aug 24 07:58:29.476667 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant: tempest-VolumesNegativeTest-1029917363 Aug 24 07:58:29.476667 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Id: 7701e6492dd940df87340ba204be3138 Aug 24 07:58:29.476667 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Name: tempest-VolumesNegativeTest-1029917363 Aug 24 07:58:29.476667 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User: tempest-VolumesNegativeTest-1029917363-project Aug 24 07:58:29.476667 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Id: default Aug 24 07:58:29.476667 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Name: Default Aug 24 07:58:29.476667 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Id: 5fe89d8592a44993838fc4acac83f974 Aug 24 07:58:29.476667 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Name: tempest-VolumesNegativeTest-1029917363-project Aug 24 07:58:29.476667 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: method: > Aug 24 07:58:29.476667 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: exception: Instance 8488563b-2a6e-4b80-acb6-ac843a6d6dcb could not be found. Aug 24 07:58:29.476667 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: action_args: {'id': '8488563b-2a6e-4b80-acb6-ac843a6d6dcb'} Aug 24 07:58:29.477414 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:58:29.477414 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:58:29.477414 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:58:29.477414 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:58:29.477414 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:58:29.477414 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:58:29.477414 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:58:29.477414 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:58:29.477414 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:58:29.477414 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:58:29.477414 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8488563b-2a6e-4b80-acb6-ac843a6d6dcb could not be found. Aug 24 07:58:29.477414 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:58:29.477414 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:58:29.477414 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:58:29.477414 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:58:29.477414 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:58:29.477414 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:58:29.477414 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:58:29.477414 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:58:29.477414 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:58:29.479406 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:58:29.479406 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:58:29.479406 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:58:29.479406 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:58:29.479406 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:58:29.479406 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:58:29.479406 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:58:29.479406 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8488563b-2a6e-4b80-acb6-ac843a6d6dcb could not be found. Aug 24 07:58:29.479406 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:58:29.479406 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:58:29.479406 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:58:29.479406 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:58:29.479406 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:58:29.479406 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:58:29.479406 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:58:29.479406 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:58:29.479406 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8488563b-2a6e-4b80-acb6-ac843a6d6dcb could not be found. Aug 24 07:58:29.479406 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 07:58:29.482013 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-c78c026b-f56c-4b8a-8879-2e9b24018ca1 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] Returning 404 to user: Instance 8488563b-2a6e-4b80-acb6-ac843a6d6dcb could not be found. {{(pid=127590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:58:29.483222 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-c78c026b-f56c-4b8a-8879-2e9b24018ca1 tempest-VolumesNegativeTest-1029917363 tempest-VolumesNegativeTest-1029917363-project] 10.222.0.72 "GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb" status: 404 len: 111 microversion: 2.1 time: 0.045027 Aug 24 07:58:29.483994 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 193/380] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:29 2022] GET /compute/v2.1/servers/8488563b-2a6e-4b80-acb6-ac843a6d6dcb => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 07:58:29.533072 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-bee18a29-20ee-4df0-94c2-755155ab63c8 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:29.551114 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-bee18a29-20ee-4df0-94c2-755155ab63c8 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:29.554274 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-bee18a29-20ee-4df0-94c2-755155ab63c8 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:29.556131 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-bee18a29-20ee-4df0-94c2-755155ab63c8 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1750 microversion: 2.20 time: 0.209281 Aug 24 07:58:29.557657 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 188/381] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:29 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1750 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:30.582009 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-13cde70d-f3b6-4e0a-990d-d4303ba46dd1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:30.582615 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-13cde70d-f3b6-4e0a-990d-d4303ba46dd1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:30.591398 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-13cde70d-f3b6-4e0a-990d-d4303ba46dd1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:30.592180 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-13cde70d-f3b6-4e0a-990d-d4303ba46dd1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:30.592910 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-13cde70d-f3b6-4e0a-990d-d4303ba46dd1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:30.593883 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-13cde70d-f3b6-4e0a-990d-d4303ba46dd1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:30.594602 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-13cde70d-f3b6-4e0a-990d-d4303ba46dd1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:30.595363 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-13cde70d-f3b6-4e0a-990d-d4303ba46dd1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:30.747128 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-13cde70d-f3b6-4e0a-990d-d4303ba46dd1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:30.757122 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-13cde70d-f3b6-4e0a-990d-d4303ba46dd1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:30.763840 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-13cde70d-f3b6-4e0a-990d-d4303ba46dd1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:30.765589 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-13cde70d-f3b6-4e0a-990d-d4303ba46dd1 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1750 microversion: 2.20 time: 0.188012 Aug 24 07:58:30.766358 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 194/382] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:30 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1750 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:31.793830 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-98a1d175-c7c5-4921-a50a-f39401c7a059 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:31.796822 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-98a1d175-c7c5-4921-a50a-f39401c7a059 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:31.803519 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-98a1d175-c7c5-4921-a50a-f39401c7a059 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:31.804079 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-98a1d175-c7c5-4921-a50a-f39401c7a059 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:31.804517 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-98a1d175-c7c5-4921-a50a-f39401c7a059 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:31.805243 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-98a1d175-c7c5-4921-a50a-f39401c7a059 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:31.805858 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-98a1d175-c7c5-4921-a50a-f39401c7a059 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:31.806440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-98a1d175-c7c5-4921-a50a-f39401c7a059 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:31.957253 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-98a1d175-c7c5-4921-a50a-f39401c7a059 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:31.969423 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-98a1d175-c7c5-4921-a50a-f39401c7a059 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:31.971515 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-98a1d175-c7c5-4921-a50a-f39401c7a059 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:31.972938 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-98a1d175-c7c5-4921-a50a-f39401c7a059 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1750 microversion: 2.20 time: 0.184714 Aug 24 07:58:31.973496 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 189/383] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:31 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1750 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:32.996917 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-1b114354-3ee8-4d5a-a467-2bb13c6a2f9a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:32.997473 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-1b114354-3ee8-4d5a-a467-2bb13c6a2f9a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:33.004680 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1b114354-3ee8-4d5a-a467-2bb13c6a2f9a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:33.005268 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1b114354-3ee8-4d5a-a467-2bb13c6a2f9a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:33.005804 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1b114354-3ee8-4d5a-a467-2bb13c6a2f9a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:33.006510 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1b114354-3ee8-4d5a-a467-2bb13c6a2f9a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:33.006993 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1b114354-3ee8-4d5a-a467-2bb13c6a2f9a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:33.007417 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1b114354-3ee8-4d5a-a467-2bb13c6a2f9a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:33.012326 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:33.154144 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-1b114354-3ee8-4d5a-a467-2bb13c6a2f9a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:33.164036 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-1b114354-3ee8-4d5a-a467-2bb13c6a2f9a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:33.165636 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-1b114354-3ee8-4d5a-a467-2bb13c6a2f9a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:33.166970 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-1b114354-3ee8-4d5a-a467-2bb13c6a2f9a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1750 microversion: 2.20 time: 0.174537 Aug 24 07:58:33.167676 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 195/384] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:32 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1750 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:34.190678 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-8102cba7-b1f6-43f3-adc9-7c24cc725eb5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:34.191851 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-8102cba7-b1f6-43f3-adc9-7c24cc725eb5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:34.198591 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8102cba7-b1f6-43f3-adc9-7c24cc725eb5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:34.212198 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8102cba7-b1f6-43f3-adc9-7c24cc725eb5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:34.212198 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8102cba7-b1f6-43f3-adc9-7c24cc725eb5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:34.212198 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8102cba7-b1f6-43f3-adc9-7c24cc725eb5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:34.212198 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8102cba7-b1f6-43f3-adc9-7c24cc725eb5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:34.212738 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8102cba7-b1f6-43f3-adc9-7c24cc725eb5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:34.444952 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-8102cba7-b1f6-43f3-adc9-7c24cc725eb5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:34.469805 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-8102cba7-b1f6-43f3-adc9-7c24cc725eb5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:34.478535 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-8102cba7-b1f6-43f3-adc9-7c24cc725eb5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:34.481366 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-8102cba7-b1f6-43f3-adc9-7c24cc725eb5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1750 microversion: 2.20 time: 0.293123 Aug 24 07:58:34.484696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 190/385] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:34 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1750 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:35.516473 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-54c033a3-54a3-4df4-a853-2dd04dc4e6cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:35.518098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-54c033a3-54a3-4df4-a853-2dd04dc4e6cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:35.540141 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-54c033a3-54a3-4df4-a853-2dd04dc4e6cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:35.540643 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-54c033a3-54a3-4df4-a853-2dd04dc4e6cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:35.541115 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-54c033a3-54a3-4df4-a853-2dd04dc4e6cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:35.546313 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-54c033a3-54a3-4df4-a853-2dd04dc4e6cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:35.546937 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-54c033a3-54a3-4df4-a853-2dd04dc4e6cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:35.547399 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-54c033a3-54a3-4df4-a853-2dd04dc4e6cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:35.728480 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-54c033a3-54a3-4df4-a853-2dd04dc4e6cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:35.738668 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-54c033a3-54a3-4df4-a853-2dd04dc4e6cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:35.740313 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-54c033a3-54a3-4df4-a853-2dd04dc4e6cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:35.742341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-54c033a3-54a3-4df4-a853-2dd04dc4e6cf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1752 microversion: 2.20 time: 0.236084 Aug 24 07:58:35.743474 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 196/386] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:35 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1752 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:36.770467 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-1eaafdbc-ff49-4142-9071-20f4ebc1a0ab tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:36.771108 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-1eaafdbc-ff49-4142-9071-20f4ebc1a0ab tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:36.778746 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1eaafdbc-ff49-4142-9071-20f4ebc1a0ab tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:36.781040 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1eaafdbc-ff49-4142-9071-20f4ebc1a0ab tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:36.781040 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1eaafdbc-ff49-4142-9071-20f4ebc1a0ab tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:36.781040 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1eaafdbc-ff49-4142-9071-20f4ebc1a0ab tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:36.781040 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1eaafdbc-ff49-4142-9071-20f4ebc1a0ab tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:36.781493 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1eaafdbc-ff49-4142-9071-20f4ebc1a0ab tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:36.934275 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-1eaafdbc-ff49-4142-9071-20f4ebc1a0ab tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:36.946596 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-1eaafdbc-ff49-4142-9071-20f4ebc1a0ab tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:36.946596 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-1eaafdbc-ff49-4142-9071-20f4ebc1a0ab tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:36.947158 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-1eaafdbc-ff49-4142-9071-20f4ebc1a0ab tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1752 microversion: 2.20 time: 0.180692 Aug 24 07:58:36.947871 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 191/387] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:36 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1752 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:37.983642 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-357bbf15-7e48-464e-a413-62bdb592851e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:37.983642 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-357bbf15-7e48-464e-a413-62bdb592851e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:37.999248 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-357bbf15-7e48-464e-a413-62bdb592851e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:37.999929 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-357bbf15-7e48-464e-a413-62bdb592851e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:38.000524 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-357bbf15-7e48-464e-a413-62bdb592851e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:38.001426 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-357bbf15-7e48-464e-a413-62bdb592851e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:38.002093 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-357bbf15-7e48-464e-a413-62bdb592851e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:38.002710 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-357bbf15-7e48-464e-a413-62bdb592851e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:38.153190 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-357bbf15-7e48-464e-a413-62bdb592851e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:38.162403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-357bbf15-7e48-464e-a413-62bdb592851e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:38.163938 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-357bbf15-7e48-464e-a413-62bdb592851e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:38.165148 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-357bbf15-7e48-464e-a413-62bdb592851e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.189082 Aug 24 07:58:38.165708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 197/388] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:37 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:39.187347 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-19f866b1-662d-4510-ab1e-6d8008625ded tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:39.187967 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-19f866b1-662d-4510-ab1e-6d8008625ded tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:39.194926 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-19f866b1-662d-4510-ab1e-6d8008625ded tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:39.195429 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-19f866b1-662d-4510-ab1e-6d8008625ded tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:39.195869 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-19f866b1-662d-4510-ab1e-6d8008625ded tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:39.196598 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-19f866b1-662d-4510-ab1e-6d8008625ded tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:39.197067 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-19f866b1-662d-4510-ab1e-6d8008625ded tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:39.197493 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-19f866b1-662d-4510-ab1e-6d8008625ded tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:39.335435 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-19f866b1-662d-4510-ab1e-6d8008625ded tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:39.345850 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-19f866b1-662d-4510-ab1e-6d8008625ded tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:39.345850 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-19f866b1-662d-4510-ab1e-6d8008625ded tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:39.347013 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-19f866b1-662d-4510-ab1e-6d8008625ded tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.163604 Aug 24 07:58:39.347785 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 192/389] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:39 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:40.370959 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-e484260a-b774-4f3c-b092-4a303a056d77 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:40.371572 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-e484260a-b774-4f3c-b092-4a303a056d77 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:40.377880 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e484260a-b774-4f3c-b092-4a303a056d77 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:40.378364 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e484260a-b774-4f3c-b092-4a303a056d77 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:40.378802 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e484260a-b774-4f3c-b092-4a303a056d77 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:40.379500 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e484260a-b774-4f3c-b092-4a303a056d77 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:40.379953 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e484260a-b774-4f3c-b092-4a303a056d77 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:40.380382 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e484260a-b774-4f3c-b092-4a303a056d77 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:40.582956 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-e484260a-b774-4f3c-b092-4a303a056d77 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:40.597424 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-e484260a-b774-4f3c-b092-4a303a056d77 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:40.608336 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-e484260a-b774-4f3c-b092-4a303a056d77 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:40.615176 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-e484260a-b774-4f3c-b092-4a303a056d77 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.247581 Aug 24 07:58:40.617036 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 198/390] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:40 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:58:41.644690 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-bd5091f9-31a7-4881-92d4-c6f501d2e89f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:41.644690 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-bd5091f9-31a7-4881-92d4-c6f501d2e89f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:41.652946 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:41.655773 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bd5091f9-31a7-4881-92d4-c6f501d2e89f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:41.656538 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bd5091f9-31a7-4881-92d4-c6f501d2e89f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:41.658119 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bd5091f9-31a7-4881-92d4-c6f501d2e89f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:41.659204 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bd5091f9-31a7-4881-92d4-c6f501d2e89f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:41.660495 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bd5091f9-31a7-4881-92d4-c6f501d2e89f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:41.661326 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bd5091f9-31a7-4881-92d4-c6f501d2e89f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:41.882680 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-bd5091f9-31a7-4881-92d4-c6f501d2e89f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:41.893030 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-bd5091f9-31a7-4881-92d4-c6f501d2e89f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:41.894692 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-bd5091f9-31a7-4881-92d4-c6f501d2e89f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:41.896157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-bd5091f9-31a7-4881-92d4-c6f501d2e89f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.260160 Aug 24 07:58:41.913492 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 193/391] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:41 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:42.920336 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-4a7a3743-5f52-4891-8ac0-e7ec02ac00bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:42.921027 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-4a7a3743-5f52-4891-8ac0-e7ec02ac00bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:42.931482 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4a7a3743-5f52-4891-8ac0-e7ec02ac00bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:42.931987 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4a7a3743-5f52-4891-8ac0-e7ec02ac00bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:42.932429 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4a7a3743-5f52-4891-8ac0-e7ec02ac00bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:42.933183 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4a7a3743-5f52-4891-8ac0-e7ec02ac00bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:42.933641 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4a7a3743-5f52-4891-8ac0-e7ec02ac00bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:42.934068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4a7a3743-5f52-4891-8ac0-e7ec02ac00bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:43.260547 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-4a7a3743-5f52-4891-8ac0-e7ec02ac00bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:43.273238 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-4a7a3743-5f52-4891-8ac0-e7ec02ac00bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:43.275197 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-4a7a3743-5f52-4891-8ac0-e7ec02ac00bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:43.276643 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-4a7a3743-5f52-4891-8ac0-e7ec02ac00bd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.360959 Aug 24 07:58:43.323095 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 199/392] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:42 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:44.311846 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-aa459220-ca6a-427d-9269-1a229ee0d52a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:44.313516 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-aa459220-ca6a-427d-9269-1a229ee0d52a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:44.321757 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-aa459220-ca6a-427d-9269-1a229ee0d52a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:44.321757 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-aa459220-ca6a-427d-9269-1a229ee0d52a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:44.321757 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-aa459220-ca6a-427d-9269-1a229ee0d52a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:44.322706 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-aa459220-ca6a-427d-9269-1a229ee0d52a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:44.322818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-aa459220-ca6a-427d-9269-1a229ee0d52a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:44.323472 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-aa459220-ca6a-427d-9269-1a229ee0d52a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:44.555289 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-aa459220-ca6a-427d-9269-1a229ee0d52a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:44.565342 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-aa459220-ca6a-427d-9269-1a229ee0d52a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:44.567140 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-aa459220-ca6a-427d-9269-1a229ee0d52a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:44.569456 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-aa459220-ca6a-427d-9269-1a229ee0d52a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.271944 Aug 24 07:58:44.580196 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 194/393] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:44 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:45.599479 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-f7f90883-5edc-4598-a346-b7a34e35e156 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:45.605458 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-f7f90883-5edc-4598-a346-b7a34e35e156 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:45.619371 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:45.621407 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f7f90883-5edc-4598-a346-b7a34e35e156 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:45.623881 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f7f90883-5edc-4598-a346-b7a34e35e156 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:45.628756 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f7f90883-5edc-4598-a346-b7a34e35e156 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:45.629568 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f7f90883-5edc-4598-a346-b7a34e35e156 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:45.630059 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f7f90883-5edc-4598-a346-b7a34e35e156 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:45.630478 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f7f90883-5edc-4598-a346-b7a34e35e156 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:45.870489 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-f7f90883-5edc-4598-a346-b7a34e35e156 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:45.881454 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-f7f90883-5edc-4598-a346-b7a34e35e156 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:45.883177 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-f7f90883-5edc-4598-a346-b7a34e35e156 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:45.884547 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-f7f90883-5edc-4598-a346-b7a34e35e156 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.291829 Aug 24 07:58:45.885782 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 200/394] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:45 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:46.913920 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-88187c8e-5247-4580-9be0-c636bfb47b60 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:46.931753 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-88187c8e-5247-4580-9be0-c636bfb47b60 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:46.939416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-88187c8e-5247-4580-9be0-c636bfb47b60 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:46.939416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-88187c8e-5247-4580-9be0-c636bfb47b60 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:46.966177 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-88187c8e-5247-4580-9be0-c636bfb47b60 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:46.972535 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-88187c8e-5247-4580-9be0-c636bfb47b60 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:46.973098 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-88187c8e-5247-4580-9be0-c636bfb47b60 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:46.973889 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-88187c8e-5247-4580-9be0-c636bfb47b60 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:47.331324 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-88187c8e-5247-4580-9be0-c636bfb47b60 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:47.338666 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-88187c8e-5247-4580-9be0-c636bfb47b60 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:47.340622 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-88187c8e-5247-4580-9be0-c636bfb47b60 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:47.343521 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-88187c8e-5247-4580-9be0-c636bfb47b60 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.434861 Aug 24 07:58:47.346072 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 195/395] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:46 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:58:48.372830 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-0f7f09b8-2c68-4d5e-ac05-a36083b15ce2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:48.373441 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-0f7f09b8-2c68-4d5e-ac05-a36083b15ce2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:48.386801 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0f7f09b8-2c68-4d5e-ac05-a36083b15ce2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:48.391591 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0f7f09b8-2c68-4d5e-ac05-a36083b15ce2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:48.391591 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0f7f09b8-2c68-4d5e-ac05-a36083b15ce2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:48.391591 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0f7f09b8-2c68-4d5e-ac05-a36083b15ce2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:48.391591 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0f7f09b8-2c68-4d5e-ac05-a36083b15ce2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:48.392109 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0f7f09b8-2c68-4d5e-ac05-a36083b15ce2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:48.534525 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-0f7f09b8-2c68-4d5e-ac05-a36083b15ce2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:48.544806 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-0f7f09b8-2c68-4d5e-ac05-a36083b15ce2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:48.546376 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-0f7f09b8-2c68-4d5e-ac05-a36083b15ce2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:48.547554 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-0f7f09b8-2c68-4d5e-ac05-a36083b15ce2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.179421 Aug 24 07:58:48.548134 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 201/396] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:48 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:58:49.576875 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-8efcde40-e7f9-4e51-a894-12cf79138d2b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:49.580023 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-8efcde40-e7f9-4e51-a894-12cf79138d2b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:49.587938 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8efcde40-e7f9-4e51-a894-12cf79138d2b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:49.588787 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8efcde40-e7f9-4e51-a894-12cf79138d2b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:49.589594 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8efcde40-e7f9-4e51-a894-12cf79138d2b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:49.590520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8efcde40-e7f9-4e51-a894-12cf79138d2b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:49.591145 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8efcde40-e7f9-4e51-a894-12cf79138d2b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:49.592072 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8efcde40-e7f9-4e51-a894-12cf79138d2b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:49.940585 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-8efcde40-e7f9-4e51-a894-12cf79138d2b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:49.959093 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-8efcde40-e7f9-4e51-a894-12cf79138d2b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:49.962380 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-8efcde40-e7f9-4e51-a894-12cf79138d2b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:49.963990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-8efcde40-e7f9-4e51-a894-12cf79138d2b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.396188 Aug 24 07:58:49.987486 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 196/397] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:49 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:50.990353 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-deae93ec-ad84-41a8-bebd-119712baf219 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:50.991085 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-deae93ec-ad84-41a8-bebd-119712baf219 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:50.997520 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-deae93ec-ad84-41a8-bebd-119712baf219 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:50.998076 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-deae93ec-ad84-41a8-bebd-119712baf219 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:50.998633 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-deae93ec-ad84-41a8-bebd-119712baf219 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:50.999759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-deae93ec-ad84-41a8-bebd-119712baf219 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:50.999926 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-deae93ec-ad84-41a8-bebd-119712baf219 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:51.000262 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-deae93ec-ad84-41a8-bebd-119712baf219 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:51.393395 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-deae93ec-ad84-41a8-bebd-119712baf219 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:51.414171 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-deae93ec-ad84-41a8-bebd-119712baf219 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:51.416254 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-deae93ec-ad84-41a8-bebd-119712baf219 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:51.417802 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-deae93ec-ad84-41a8-bebd-119712baf219 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.431095 Aug 24 07:58:51.420135 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 202/398] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:50 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:52.444754 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-190ba88e-e499-47b6-a351-6ce8c15e91d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:52.447803 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-190ba88e-e499-47b6-a351-6ce8c15e91d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:52.455614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-190ba88e-e499-47b6-a351-6ce8c15e91d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:52.456116 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-190ba88e-e499-47b6-a351-6ce8c15e91d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:52.456548 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-190ba88e-e499-47b6-a351-6ce8c15e91d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:52.457311 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-190ba88e-e499-47b6-a351-6ce8c15e91d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:52.457764 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-190ba88e-e499-47b6-a351-6ce8c15e91d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:52.458188 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-190ba88e-e499-47b6-a351-6ce8c15e91d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:52.715719 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-190ba88e-e499-47b6-a351-6ce8c15e91d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:52.728967 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-190ba88e-e499-47b6-a351-6ce8c15e91d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:52.728967 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-190ba88e-e499-47b6-a351-6ce8c15e91d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:52.728967 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-190ba88e-e499-47b6-a351-6ce8c15e91d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.288524 Aug 24 07:58:52.729512 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 197/399] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:52 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:53.751743 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-6cab2333-f027-447e-b634-86014914c3dc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:53.752366 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-6cab2333-f027-447e-b634-86014914c3dc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:53.759390 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6cab2333-f027-447e-b634-86014914c3dc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:53.759874 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6cab2333-f027-447e-b634-86014914c3dc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:53.760531 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6cab2333-f027-447e-b634-86014914c3dc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:53.761382 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6cab2333-f027-447e-b634-86014914c3dc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:53.761842 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6cab2333-f027-447e-b634-86014914c3dc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:53.762268 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6cab2333-f027-447e-b634-86014914c3dc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:53.960939 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-6cab2333-f027-447e-b634-86014914c3dc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:53.988093 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-6cab2333-f027-447e-b634-86014914c3dc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:53.991820 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-6cab2333-f027-447e-b634-86014914c3dc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:53.995036 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-6cab2333-f027-447e-b634-86014914c3dc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.246160 Aug 24 07:58:53.995036 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 203/400] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:53 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:55.017706 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-ff9a842b-3549-4508-8b7c-9a51e2662797 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:55.018371 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-ff9a842b-3549-4508-8b7c-9a51e2662797 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:55.034271 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ff9a842b-3549-4508-8b7c-9a51e2662797 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:55.034773 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ff9a842b-3549-4508-8b7c-9a51e2662797 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:55.035225 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ff9a842b-3549-4508-8b7c-9a51e2662797 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:55.035932 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ff9a842b-3549-4508-8b7c-9a51e2662797 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:55.036386 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ff9a842b-3549-4508-8b7c-9a51e2662797 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:55.036846 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ff9a842b-3549-4508-8b7c-9a51e2662797 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:55.222751 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-ff9a842b-3549-4508-8b7c-9a51e2662797 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:55.234235 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-ff9a842b-3549-4508-8b7c-9a51e2662797 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:55.241826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-ff9a842b-3549-4508-8b7c-9a51e2662797 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:55.241826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-ff9a842b-3549-4508-8b7c-9a51e2662797 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.225136 Aug 24 07:58:55.241826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 198/401] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:55 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:56.263502 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-1658d55e-1229-4891-b0c3-625d0a4e0127 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:56.265735 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-1658d55e-1229-4891-b0c3-625d0a4e0127 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:56.275056 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1658d55e-1229-4891-b0c3-625d0a4e0127 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:56.275716 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1658d55e-1229-4891-b0c3-625d0a4e0127 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:56.276196 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1658d55e-1229-4891-b0c3-625d0a4e0127 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:56.281505 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1658d55e-1229-4891-b0c3-625d0a4e0127 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:56.282058 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1658d55e-1229-4891-b0c3-625d0a4e0127 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:56.282509 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1658d55e-1229-4891-b0c3-625d0a4e0127 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:56.450508 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-1658d55e-1229-4891-b0c3-625d0a4e0127 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:56.462947 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-1658d55e-1229-4891-b0c3-625d0a4e0127 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:56.464980 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-1658d55e-1229-4891-b0c3-625d0a4e0127 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:56.466476 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-1658d55e-1229-4891-b0c3-625d0a4e0127 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.207632 Aug 24 07:58:56.467648 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 204/402] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:56 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:57.212597 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-7d8e5dbb-8645-404d-a7b5-2a2cd8a44783 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1593773716", "imageRef": "ccdab334-55ce-4ff5-bd97-5a424660c282", "flavorRef": "452", "networks": [{"uuid": "a3255728-56b0-475b-8190-6ecfc66d7231"}]}} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:58:57.306330 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.network.neutron [None req-7d8e5dbb-8645-404d-a7b5-2a2cd8a44783 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] validate_networks() for [('a3255728-56b0-475b-8190-6ecfc66d7231', None, None, None, None, None)] {{(pid=127589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:58:57.491646 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-6f1830f5-08d8-4b50-bd42-19669c69cb21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:57.493043 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-6f1830f5-08d8-4b50-bd42-19669c69cb21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:57.510711 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6f1830f5-08d8-4b50-bd42-19669c69cb21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:57.511353 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6f1830f5-08d8-4b50-bd42-19669c69cb21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:57.511822 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6f1830f5-08d8-4b50-bd42-19669c69cb21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:57.512565 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6f1830f5-08d8-4b50-bd42-19669c69cb21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:57.519511 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6f1830f5-08d8-4b50-bd42-19669c69cb21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:57.528919 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6f1830f5-08d8-4b50-bd42-19669c69cb21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:57.819272 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-6f1830f5-08d8-4b50-bd42-19669c69cb21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:57.835065 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-6f1830f5-08d8-4b50-bd42-19669c69cb21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:57.838409 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-6f1830f5-08d8-4b50-bd42-19669c69cb21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:57.840117 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-6f1830f5-08d8-4b50-bd42-19669c69cb21 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.353478 Aug 24 07:58:57.842103 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 205/403] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:57 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:58:57.850945 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-7eace631-c8c3-4d6b-9c90-d4195a014ead tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b2a9569-edc5-4595-bfb1-85cf0714c6df"}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:58:57.853681 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-7eace631-c8c3-4d6b-9c90-d4195a014ead tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:57.864629 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7eace631-c8c3-4d6b-9c90-d4195a014ead tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:57.865605 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7eace631-c8c3-4d6b-9c90-d4195a014ead tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:57.866601 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7eace631-c8c3-4d6b-9c90-d4195a014ead tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:57.868591 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7eace631-c8c3-4d6b-9c90-d4195a014ead tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:57.869258 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7eace631-c8c3-4d6b-9c90-d4195a014ead tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:57.869941 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7eace631-c8c3-4d6b-9c90-d4195a014ead tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:58.108980 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-7d8e5dbb-8645-404d-a7b5-2a2cd8a44783 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Flavor limits 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:58:58.113370 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-7d8e5dbb-8645-404d-a7b5-2a2cd8a44783 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Image limits 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:58:58.113370 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-7d8e5dbb-8645-404d-a7b5-2a2cd8a44783 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Flavor pref 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:58:58.113370 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-7d8e5dbb-8645-404d-a7b5-2a2cd8a44783 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Image pref 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:58:58.113370 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-7d8e5dbb-8645-404d-a7b5-2a2cd8a44783 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:58:58.149774 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7d8e5dbb-8645-404d-a7b5-2a2cd8a44783 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:58.149774 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7d8e5dbb-8645-404d-a7b5-2a2cd8a44783 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:58.149774 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7d8e5dbb-8645-404d-a7b5-2a2cd8a44783 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:58.153031 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7d8e5dbb-8645-404d-a7b5-2a2cd8a44783 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:58.153664 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7d8e5dbb-8645-404d-a7b5-2a2cd8a44783 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:58.154122 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7d8e5dbb-8645-404d-a7b5-2a2cd8a44783 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:58.211730 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.quota [None req-7d8e5dbb-8645-404d-a7b5-2a2cd8a44783 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Getting quotas for project c534e991899e457c8b41e1dbc12a6670. Resources: {'cores', 'instances', 'ram'} {{(pid=127589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:58:58.216910 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.quota [None req-7d8e5dbb-8645-404d-a7b5-2a2cd8a44783 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Getting quotas for user 5a8de6b6200840dbb9c4d7a3b728f9c2 and project c534e991899e457c8b41e1dbc12a6670. Resources: {'cores', 'instances', 'ram'} {{(pid=127589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:58:58.232806 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-7d8e5dbb-8645-404d-a7b5-2a2cd8a44783 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Going to run 1 instances... {{(pid=127589) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:58:58.235969 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-7d8e5dbb-8645-404d-a7b5-2a2cd8a44783 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccdab334-55ce-4ff5-bd97-5a424660c282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:58:58.371157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-7d8e5dbb-8645-404d-a7b5-2a2cd8a44783 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.168743 Aug 24 07:58:58.372428 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 199/404] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 24 07:58:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:58:58.388001 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-407940b3-64dd-48d6-a449-800171591430 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:58.388763 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-407940b3-64dd-48d6-a449-800171591430 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:58.574393 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-407940b3-64dd-48d6-a449-800171591430 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:58.585703 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-407940b3-64dd-48d6-a449-800171591430 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1219 microversion: 2.1 time: 0.204108 Aug 24 07:58:58.601158 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 200/405] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:58 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1219 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:58.866152 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-cc19aec8-5046-4a3d-aaa1-ad2eac95945e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:58.867098 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-cc19aec8-5046-4a3d-aaa1-ad2eac95945e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:58.875611 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc19aec8-5046-4a3d-aaa1-ad2eac95945e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:58.876302 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc19aec8-5046-4a3d-aaa1-ad2eac95945e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:58.876920 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc19aec8-5046-4a3d-aaa1-ad2eac95945e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:58.877990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc19aec8-5046-4a3d-aaa1-ad2eac95945e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:58.878611 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc19aec8-5046-4a3d-aaa1-ad2eac95945e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:58.879526 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc19aec8-5046-4a3d-aaa1-ad2eac95945e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:58.986582 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-7eace631-c8c3-4d6b-9c90-d4195a014ead tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "POST /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.143023 Aug 24 07:58:58.994456 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 206/406] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 24 07:58:57 2022] POST /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55/os-volume_attachments => generated 194 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:58:59.163681 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-cc19aec8-5046-4a3d-aaa1-ad2eac95945e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:59.177782 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-cc19aec8-5046-4a3d-aaa1-ad2eac95945e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:59.179901 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-cc19aec8-5046-4a3d-aaa1-ad2eac95945e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:59.186049 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-cc19aec8-5046-4a3d-aaa1-ad2eac95945e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.324604 Aug 24 07:58:59.188077 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 201/407] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:58:58 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:58:59.615606 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-bfc0a888-25cd-445b-aae6-33441173bd53 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:59.616309 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-bfc0a888-25cd-445b-aae6-33441173bd53 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:59.679894 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-bfc0a888-25cd-445b-aae6-33441173bd53 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:59.691270 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-bfc0a888-25cd-445b-aae6-33441173bd53 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1219 microversion: 2.1 time: 0.082958 Aug 24 07:58:59.692494 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 207/408] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:59 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:59.786892 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-a196ad56-ca64-4dee-b42c-ac577c19b46f req-76cceb1e-1798-427e-b6a8-ca97870a799b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a266e179-03cc-40b3-902d-aab680174711", "name": "network-vif-plugged", "status": "completed", "tag": "45373581-1bd1-4a1b-aff0-a6e9993cd6b9"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:58:59.800796 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-a196ad56-ca64-4dee-b42c-ac577c19b46f req-76cceb1e-1798-427e-b6a8-ca97870a799b service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:59.801281 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-a196ad56-ca64-4dee-b42c-ac577c19b46f req-76cceb1e-1798-427e-b6a8-ca97870a799b service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:59.801708 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-a196ad56-ca64-4dee-b42c-ac577c19b46f req-76cceb1e-1798-427e-b6a8-ca97870a799b service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:59.812975 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=77 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:59.814866 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-a196ad56-ca64-4dee-b42c-ac577c19b46f req-76cceb1e-1798-427e-b6a8-ca97870a799b service nova] Creating event network-vif-plugged:45373581-1bd1-4a1b-aff0-a6e9993cd6b9 for instance a266e179-03cc-40b3-902d-aab680174711 on hv-cinder-85427 Aug 24 07:58:59.821649 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-a196ad56-ca64-4dee-b42c-ac577c19b46f req-76cceb1e-1798-427e-b6a8-ca97870a799b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038566 Aug 24 07:58:59.822707 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 202/409] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:59:00.210754 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-dceecd37-76e9-48ba-b710-80f4de3c4165 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:00.211983 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-dceecd37-76e9-48ba-b710-80f4de3c4165 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:00.218304 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dceecd37-76e9-48ba-b710-80f4de3c4165 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:00.218998 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dceecd37-76e9-48ba-b710-80f4de3c4165 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:00.219589 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dceecd37-76e9-48ba-b710-80f4de3c4165 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:00.221059 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dceecd37-76e9-48ba-b710-80f4de3c4165 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:00.221683 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dceecd37-76e9-48ba-b710-80f4de3c4165 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:00.222289 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dceecd37-76e9-48ba-b710-80f4de3c4165 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:00.383715 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-dceecd37-76e9-48ba-b710-80f4de3c4165 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:00.394038 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-dceecd37-76e9-48ba-b710-80f4de3c4165 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:00.395753 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-dceecd37-76e9-48ba-b710-80f4de3c4165 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:00.397015 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-dceecd37-76e9-48ba-b710-80f4de3c4165 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.190128 Aug 24 07:59:00.397587 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 208/410] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:59:00 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:59:00.720394 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-8f8b333d-3a83-4d47-8784-20931eba5377 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:00.721273 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-8f8b333d-3a83-4d47-8784-20931eba5377 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:00.731056 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8f8b333d-3a83-4d47-8784-20931eba5377 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:00.731548 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8f8b333d-3a83-4d47-8784-20931eba5377 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:00.731983 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8f8b333d-3a83-4d47-8784-20931eba5377 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:00.732697 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8f8b333d-3a83-4d47-8784-20931eba5377 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:00.733148 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8f8b333d-3a83-4d47-8784-20931eba5377 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:00.733602 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8f8b333d-3a83-4d47-8784-20931eba5377 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:00.839340 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-8f8b333d-3a83-4d47-8784-20931eba5377 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:00.853510 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-8f8b333d-3a83-4d47-8784-20931eba5377 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1215 microversion: 2.1 time: 0.138235 Aug 24 07:59:00.854399 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 203/411] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:00 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1215 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:01.421311 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-64132a66-5242-4ca5-9f78-d7ea09faff6d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:01.422265 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-64132a66-5242-4ca5-9f78-d7ea09faff6d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:01.431490 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-64132a66-5242-4ca5-9f78-d7ea09faff6d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:01.432372 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-64132a66-5242-4ca5-9f78-d7ea09faff6d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:01.433232 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-64132a66-5242-4ca5-9f78-d7ea09faff6d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:01.434158 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-64132a66-5242-4ca5-9f78-d7ea09faff6d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:01.434848 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-64132a66-5242-4ca5-9f78-d7ea09faff6d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:01.435486 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-64132a66-5242-4ca5-9f78-d7ea09faff6d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:01.473356 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-4819ee63-287d-410e-8645-25cb1d73d38d tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Action: 'create', calling method: .version_select at 0x7f320c2f7ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1957195615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8i7ZHSkMBoj1Ngb7Hs4U+P/D5FNMIKTandmMUMBwRck9usEWXAjHVZm2H0eOQZQv0zc+nBhtMqTCeiW45v93PlY/Y9YuS41931jhAkiNAxT7YygjBKnUD0AxOnEWMtCA=="}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:59:01.498693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-4819ee63-287d-410e-8645-25cb1d73d38d tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Getting quotas for project 576781ceab42470e9fd28a32ccb29e7f. Resources: {'key_pairs'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:59:01.502999 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-4819ee63-287d-410e-8645-25cb1d73d38d tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Getting quotas for user 0ae325c8314c47a384a83509e3c281a0 and project 576781ceab42470e9fd28a32ccb29e7f. Resources: {'key_pairs'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:59:01.594789 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-4819ee63-287d-410e-8645-25cb1d73d38d tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.448574 Aug 24 07:59:01.595402 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 209/412] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 24 07:59:01 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:59:01.622437 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-64132a66-5242-4ca5-9f78-d7ea09faff6d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:01.631360 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-64132a66-5242-4ca5-9f78-d7ea09faff6d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:01.632910 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-64132a66-5242-4ca5-9f78-d7ea09faff6d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:01.634066 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-64132a66-5242-4ca5-9f78-d7ea09faff6d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.217049 Aug 24 07:59:01.634619 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 204/413] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:59:01 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:59:01.887395 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-9636181e-0cfa-4888-a13f-d849f8bfc0df tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:01.887932 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-9636181e-0cfa-4888-a13f-d849f8bfc0df tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:01.893979 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9636181e-0cfa-4888-a13f-d849f8bfc0df tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:01.894455 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9636181e-0cfa-4888-a13f-d849f8bfc0df tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:01.894880 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9636181e-0cfa-4888-a13f-d849f8bfc0df tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:01.895557 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9636181e-0cfa-4888-a13f-d849f8bfc0df tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:01.896001 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9636181e-0cfa-4888-a13f-d849f8bfc0df tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:01.896418 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9636181e-0cfa-4888-a13f-d849f8bfc0df tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:01.967309 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9636181e-0cfa-4888-a13f-d849f8bfc0df tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:01.977688 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-9636181e-0cfa-4888-a13f-d849f8bfc0df tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1271 microversion: 2.1 time: 0.094087 Aug 24 07:59:01.978851 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 210/414] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:01 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:02.657647 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-81acc919-b4e5-4567-948e-31e8a4d40227 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:02.658510 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-81acc919-b4e5-4567-948e-31e8a4d40227 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:02.665489 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-81acc919-b4e5-4567-948e-31e8a4d40227 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:02.665971 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-81acc919-b4e5-4567-948e-31e8a4d40227 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:02.666407 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-81acc919-b4e5-4567-948e-31e8a4d40227 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:02.667109 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-81acc919-b4e5-4567-948e-31e8a4d40227 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:02.667565 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-81acc919-b4e5-4567-948e-31e8a4d40227 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:02.667989 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-81acc919-b4e5-4567-948e-31e8a4d40227 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:02.816293 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-81acc919-b4e5-4567-948e-31e8a4d40227 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:02.826683 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-81acc919-b4e5-4567-948e-31e8a4d40227 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:02.828519 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-81acc919-b4e5-4567-948e-31e8a4d40227 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:02.830009 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-81acc919-b4e5-4567-948e-31e8a4d40227 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.176308 Aug 24 07:59:02.831038 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 205/415] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:59:02 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:59:03.000903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-23b151fe-a4ee-468c-9dc6-da952a050493 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:03.001702 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-23b151fe-a4ee-468c-9dc6-da952a050493 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:03.019543 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-23b151fe-a4ee-468c-9dc6-da952a050493 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:03.020117 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-23b151fe-a4ee-468c-9dc6-da952a050493 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:03.020939 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-23b151fe-a4ee-468c-9dc6-da952a050493 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:03.021463 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-23b151fe-a4ee-468c-9dc6-da952a050493 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:03.022631 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-23b151fe-a4ee-468c-9dc6-da952a050493 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:03.022802 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-23b151fe-a4ee-468c-9dc6-da952a050493 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:03.109477 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-23b151fe-a4ee-468c-9dc6-da952a050493 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:03.120129 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-23b151fe-a4ee-468c-9dc6-da952a050493 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1271 microversion: 2.1 time: 0.125145 Aug 24 07:59:03.120710 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 211/416] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:02 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1271 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:03.859378 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-1b013d27-9e1b-4123-8b1f-f0d2d11c43c2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:03.859982 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-1b013d27-9e1b-4123-8b1f-f0d2d11c43c2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:03.868798 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1b013d27-9e1b-4123-8b1f-f0d2d11c43c2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:03.869623 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1b013d27-9e1b-4123-8b1f-f0d2d11c43c2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:03.870287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1b013d27-9e1b-4123-8b1f-f0d2d11c43c2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:03.871126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1b013d27-9e1b-4123-8b1f-f0d2d11c43c2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:03.871668 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1b013d27-9e1b-4123-8b1f-f0d2d11c43c2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:03.872277 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1b013d27-9e1b-4123-8b1f-f0d2d11c43c2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:04.016666 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-1b013d27-9e1b-4123-8b1f-f0d2d11c43c2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:04.025745 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-1b013d27-9e1b-4123-8b1f-f0d2d11c43c2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:04.027296 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-1b013d27-9e1b-4123-8b1f-f0d2d11c43c2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:04.028466 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-1b013d27-9e1b-4123-8b1f-f0d2d11c43c2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.173044 Aug 24 07:59:04.029118 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 206/417] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:59:03 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:59:04.142139 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-1f670dcc-02c4-4da6-bf84-4825451fe12e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:04.142139 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-1f670dcc-02c4-4da6-bf84-4825451fe12e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:04.147704 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1f670dcc-02c4-4da6-bf84-4825451fe12e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:04.148185 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1f670dcc-02c4-4da6-bf84-4825451fe12e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:04.148622 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1f670dcc-02c4-4da6-bf84-4825451fe12e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:04.149345 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1f670dcc-02c4-4da6-bf84-4825451fe12e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:04.149802 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1f670dcc-02c4-4da6-bf84-4825451fe12e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:04.150226 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1f670dcc-02c4-4da6-bf84-4825451fe12e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:04.153110 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:04.221136 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-1f670dcc-02c4-4da6-bf84-4825451fe12e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:04.230738 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-1f670dcc-02c4-4da6-bf84-4825451fe12e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1271 microversion: 2.1 time: 0.094126 Aug 24 07:59:04.244837 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 212/418] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:04 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1271 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:05.069619 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-8e1349c7-6fc1-42cc-9258-6029769b1d31 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:05.072124 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-8e1349c7-6fc1-42cc-9258-6029769b1d31 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:05.096819 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8e1349c7-6fc1-42cc-9258-6029769b1d31 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:05.098369 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8e1349c7-6fc1-42cc-9258-6029769b1d31 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:05.099384 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8e1349c7-6fc1-42cc-9258-6029769b1d31 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:05.101038 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8e1349c7-6fc1-42cc-9258-6029769b1d31 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:05.102174 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8e1349c7-6fc1-42cc-9258-6029769b1d31 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:05.103176 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8e1349c7-6fc1-42cc-9258-6029769b1d31 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:05.252509 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-2032b9fe-2878-4201-a85c-89d8b2060a87 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:05.253181 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-2032b9fe-2878-4201-a85c-89d8b2060a87 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:05.278069 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2032b9fe-2878-4201-a85c-89d8b2060a87 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:05.279681 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2032b9fe-2878-4201-a85c-89d8b2060a87 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:05.281823 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2032b9fe-2878-4201-a85c-89d8b2060a87 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:05.290542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2032b9fe-2878-4201-a85c-89d8b2060a87 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:05.291370 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2032b9fe-2878-4201-a85c-89d8b2060a87 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:05.292004 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2032b9fe-2878-4201-a85c-89d8b2060a87 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:05.392961 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-2032b9fe-2878-4201-a85c-89d8b2060a87 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:05.404893 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-2032b9fe-2878-4201-a85c-89d8b2060a87 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1277 microversion: 2.1 time: 0.157236 Aug 24 07:59:05.406188 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 213/419] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:05 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:59:05.476271 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-8e1349c7-6fc1-42cc-9258-6029769b1d31 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:05.489192 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-8e1349c7-6fc1-42cc-9258-6029769b1d31 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:05.491381 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-8e1349c7-6fc1-42cc-9258-6029769b1d31 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:05.499875 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-8e1349c7-6fc1-42cc-9258-6029769b1d31 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.444057 Aug 24 07:59:05.508690 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 207/420] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:59:05 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:59:06.426997 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-9164f477-9393-42ca-884b-0d09bf098cff tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:06.427817 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-9164f477-9393-42ca-884b-0d09bf098cff tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:06.434703 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9164f477-9393-42ca-884b-0d09bf098cff tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:06.435251 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9164f477-9393-42ca-884b-0d09bf098cff tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:06.435696 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9164f477-9393-42ca-884b-0d09bf098cff tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:06.436395 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9164f477-9393-42ca-884b-0d09bf098cff tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:06.439872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9164f477-9393-42ca-884b-0d09bf098cff tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:06.439872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9164f477-9393-42ca-884b-0d09bf098cff tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:06.528196 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-27f3d5e6-9483-4e2e-8fb0-06ded9f273df tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:06.531486 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-27f3d5e6-9483-4e2e-8fb0-06ded9f273df tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:06.540530 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-27f3d5e6-9483-4e2e-8fb0-06ded9f273df tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:06.541474 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-27f3d5e6-9483-4e2e-8fb0-06ded9f273df tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:06.542219 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-27f3d5e6-9483-4e2e-8fb0-06ded9f273df tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:06.543611 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-27f3d5e6-9483-4e2e-8fb0-06ded9f273df tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:06.544464 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-27f3d5e6-9483-4e2e-8fb0-06ded9f273df tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:06.545425 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-27f3d5e6-9483-4e2e-8fb0-06ded9f273df tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:06.602670 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9164f477-9393-42ca-884b-0d09bf098cff tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:06.611070 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-9164f477-9393-42ca-884b-0d09bf098cff tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1319 microversion: 2.1 time: 0.188119 Aug 24 07:59:06.611636 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 214/421] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:06 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:06.701781 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-27f3d5e6-9483-4e2e-8fb0-06ded9f273df tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:06.711960 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-27f3d5e6-9483-4e2e-8fb0-06ded9f273df tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:06.714066 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-27f3d5e6-9483-4e2e-8fb0-06ded9f273df tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:06.715473 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-27f3d5e6-9483-4e2e-8fb0-06ded9f273df tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.191386 Aug 24 07:59:06.716025 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 208/422] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:59:06 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:59:07.635176 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-bb78ca1f-023d-4c59-9c45-d4c52e0870d0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:07.635772 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-bb78ca1f-023d-4c59-9c45-d4c52e0870d0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:07.642774 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bb78ca1f-023d-4c59-9c45-d4c52e0870d0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:07.643253 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bb78ca1f-023d-4c59-9c45-d4c52e0870d0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:07.643689 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bb78ca1f-023d-4c59-9c45-d4c52e0870d0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:07.644396 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bb78ca1f-023d-4c59-9c45-d4c52e0870d0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:07.644943 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bb78ca1f-023d-4c59-9c45-d4c52e0870d0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:07.645369 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bb78ca1f-023d-4c59-9c45-d4c52e0870d0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:07.739044 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-43a0760e-5041-40e3-8b58-60ecfe18a17c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:07.739748 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-43a0760e-5041-40e3-8b58-60ecfe18a17c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:07.746614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-43a0760e-5041-40e3-8b58-60ecfe18a17c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:07.747382 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-43a0760e-5041-40e3-8b58-60ecfe18a17c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:07.747898 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-43a0760e-5041-40e3-8b58-60ecfe18a17c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:07.748848 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-43a0760e-5041-40e3-8b58-60ecfe18a17c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:07.751849 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-43a0760e-5041-40e3-8b58-60ecfe18a17c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:07.752291 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-43a0760e-5041-40e3-8b58-60ecfe18a17c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:07.781041 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-bb78ca1f-023d-4c59-9c45-d4c52e0870d0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:07.789737 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-bb78ca1f-023d-4c59-9c45-d4c52e0870d0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1319 microversion: 2.1 time: 0.158919 Aug 24 07:59:07.790309 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 215/423] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:07 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:07.890122 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-43a0760e-5041-40e3-8b58-60ecfe18a17c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:07.899534 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-43a0760e-5041-40e3-8b58-60ecfe18a17c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:07.901072 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-43a0760e-5041-40e3-8b58-60ecfe18a17c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:07.902427 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-43a0760e-5041-40e3-8b58-60ecfe18a17c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.167341 Aug 24 07:59:07.902983 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 209/424] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:59:07 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:59:08.811886 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-2a780291-238a-416e-9620-67fc840e213a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:08.812495 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-2a780291-238a-416e-9620-67fc840e213a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:08.818988 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2a780291-238a-416e-9620-67fc840e213a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:08.819468 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2a780291-238a-416e-9620-67fc840e213a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:08.819908 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2a780291-238a-416e-9620-67fc840e213a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:08.821133 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2a780291-238a-416e-9620-67fc840e213a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:08.821594 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2a780291-238a-416e-9620-67fc840e213a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:08.822019 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2a780291-238a-416e-9620-67fc840e213a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:08.929852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-a082742d-b5f5-4a45-aaf9-55d7b33eacf2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:08.931058 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-a082742d-b5f5-4a45-aaf9-55d7b33eacf2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:08.933147 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=2 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:08.933834 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=8 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:08.939235 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a082742d-b5f5-4a45-aaf9-55d7b33eacf2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:08.943577 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a082742d-b5f5-4a45-aaf9-55d7b33eacf2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:08.943577 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a082742d-b5f5-4a45-aaf9-55d7b33eacf2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:08.943577 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a082742d-b5f5-4a45-aaf9-55d7b33eacf2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:08.943577 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a082742d-b5f5-4a45-aaf9-55d7b33eacf2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:08.944233 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a082742d-b5f5-4a45-aaf9-55d7b33eacf2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:08.970750 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-2a780291-238a-416e-9620-67fc840e213a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:08.986667 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-2a780291-238a-416e-9620-67fc840e213a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1319 microversion: 2.1 time: 0.178503 Aug 24 07:59:08.987419 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 216/425] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:08 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:09.126738 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a082742d-b5f5-4a45-aaf9-55d7b33eacf2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:09.135863 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a082742d-b5f5-4a45-aaf9-55d7b33eacf2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:09.137467 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a082742d-b5f5-4a45-aaf9-55d7b33eacf2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:09.138680 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-a082742d-b5f5-4a45-aaf9-55d7b33eacf2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.212707 Aug 24 07:59:09.139756 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 210/426] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:59:08 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:59:10.083522 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-84be59aa-3d09-42f5-a4e8-626b0121d58a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:10.084587 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-84be59aa-3d09-42f5-a4e8-626b0121d58a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:10.093576 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-84be59aa-3d09-42f5-a4e8-626b0121d58a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:10.094074 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-84be59aa-3d09-42f5-a4e8-626b0121d58a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:10.094700 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-84be59aa-3d09-42f5-a4e8-626b0121d58a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:10.095423 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-84be59aa-3d09-42f5-a4e8-626b0121d58a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:10.095886 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-84be59aa-3d09-42f5-a4e8-626b0121d58a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:10.096338 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-84be59aa-3d09-42f5-a4e8-626b0121d58a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:10.162856 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-7f2f123b-ff30-47a3-93bb-140df95641a3 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:10.163485 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-7f2f123b-ff30-47a3-93bb-140df95641a3 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:10.170292 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7f2f123b-ff30-47a3-93bb-140df95641a3 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:10.170754 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7f2f123b-ff30-47a3-93bb-140df95641a3 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:10.171190 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7f2f123b-ff30-47a3-93bb-140df95641a3 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:10.171883 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7f2f123b-ff30-47a3-93bb-140df95641a3 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:10.172338 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7f2f123b-ff30-47a3-93bb-140df95641a3 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:10.172786 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7f2f123b-ff30-47a3-93bb-140df95641a3 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:10.230220 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-84be59aa-3d09-42f5-a4e8-626b0121d58a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:10.238268 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-84be59aa-3d09-42f5-a4e8-626b0121d58a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1319 microversion: 2.1 time: 0.159424 Aug 24 07:59:10.238967 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 217/427] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:10 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:10.310024 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7f2f123b-ff30-47a3-93bb-140df95641a3 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:10.318692 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7f2f123b-ff30-47a3-93bb-140df95641a3 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:10.320206 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7f2f123b-ff30-47a3-93bb-140df95641a3 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:10.321427 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-7f2f123b-ff30-47a3-93bb-140df95641a3 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.162516 Aug 24 07:59:10.321979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 211/428] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:59:10 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:59:11.260177 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-d40e1ed5-a7e1-4a38-b571-95c313f703a0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:11.260938 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-d40e1ed5-a7e1-4a38-b571-95c313f703a0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:11.267468 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d40e1ed5-a7e1-4a38-b571-95c313f703a0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:11.267994 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d40e1ed5-a7e1-4a38-b571-95c313f703a0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:11.268424 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d40e1ed5-a7e1-4a38-b571-95c313f703a0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:11.269224 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d40e1ed5-a7e1-4a38-b571-95c313f703a0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:11.269586 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d40e1ed5-a7e1-4a38-b571-95c313f703a0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:11.270008 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d40e1ed5-a7e1-4a38-b571-95c313f703a0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:11.344697 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-67820f92-3aec-4fb4-8913-ae6e98346220 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:11.345966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-67820f92-3aec-4fb4-8913-ae6e98346220 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:11.354917 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-67820f92-3aec-4fb4-8913-ae6e98346220 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:11.355420 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-67820f92-3aec-4fb4-8913-ae6e98346220 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:11.355860 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-67820f92-3aec-4fb4-8913-ae6e98346220 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:11.356573 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-67820f92-3aec-4fb4-8913-ae6e98346220 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:11.357216 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-67820f92-3aec-4fb4-8913-ae6e98346220 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:11.357831 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-67820f92-3aec-4fb4-8913-ae6e98346220 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:11.428697 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-d40e1ed5-a7e1-4a38-b571-95c313f703a0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:11.438574 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-d40e1ed5-a7e1-4a38-b571-95c313f703a0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1319 microversion: 2.1 time: 0.182912 Aug 24 07:59:11.439404 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 218/429] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:11 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:11.516548 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-67820f92-3aec-4fb4-8913-ae6e98346220 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:11.526077 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-67820f92-3aec-4fb4-8913-ae6e98346220 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:11.527643 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-67820f92-3aec-4fb4-8913-ae6e98346220 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:11.530283 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-67820f92-3aec-4fb4-8913-ae6e98346220 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.188969 Aug 24 07:59:11.530283 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 212/430] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:59:11 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:59:12.460710 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-13346c07-ae1c-4ae6-b65f-c64da4402899 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:12.461348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-13346c07-ae1c-4ae6-b65f-c64da4402899 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:12.463922 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=6 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:12.469669 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-13346c07-ae1c-4ae6-b65f-c64da4402899 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:12.470164 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-13346c07-ae1c-4ae6-b65f-c64da4402899 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:12.483262 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-13346c07-ae1c-4ae6-b65f-c64da4402899 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:12.483262 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-13346c07-ae1c-4ae6-b65f-c64da4402899 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:12.483262 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-13346c07-ae1c-4ae6-b65f-c64da4402899 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:12.483262 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-13346c07-ae1c-4ae6-b65f-c64da4402899 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:12.553069 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-1629ae13-8be8-4cc2-8df9-756f613d156b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:12.553678 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-1629ae13-8be8-4cc2-8df9-756f613d156b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:12.561031 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1629ae13-8be8-4cc2-8df9-756f613d156b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:12.561513 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1629ae13-8be8-4cc2-8df9-756f613d156b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:12.561947 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1629ae13-8be8-4cc2-8df9-756f613d156b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:12.562641 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1629ae13-8be8-4cc2-8df9-756f613d156b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:12.563093 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1629ae13-8be8-4cc2-8df9-756f613d156b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:12.563565 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1629ae13-8be8-4cc2-8df9-756f613d156b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:12.609929 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-13346c07-ae1c-4ae6-b65f-c64da4402899 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:12.617633 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-13346c07-ae1c-4ae6-b65f-c64da4402899 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1319 microversion: 2.1 time: 0.160842 Aug 24 07:59:12.618199 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 219/431] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:12 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:12.697178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-1629ae13-8be8-4cc2-8df9-756f613d156b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:12.706345 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-1629ae13-8be8-4cc2-8df9-756f613d156b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:12.707843 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-1629ae13-8be8-4cc2-8df9-756f613d156b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:12.709033 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-1629ae13-8be8-4cc2-8df9-756f613d156b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.159992 Aug 24 07:59:12.709582 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 213/432] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:59:12 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:59:13.638215 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-b053aa33-6c61-4645-b0ca-e2339b4f9bc6 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:13.638822 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-b053aa33-6c61-4645-b0ca-e2339b4f9bc6 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:13.645440 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b053aa33-6c61-4645-b0ca-e2339b4f9bc6 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:13.645920 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b053aa33-6c61-4645-b0ca-e2339b4f9bc6 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:13.646358 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b053aa33-6c61-4645-b0ca-e2339b4f9bc6 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:13.647048 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b053aa33-6c61-4645-b0ca-e2339b4f9bc6 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:13.647504 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b053aa33-6c61-4645-b0ca-e2339b4f9bc6 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:13.647930 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b053aa33-6c61-4645-b0ca-e2339b4f9bc6 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:13.734368 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-ad4d2c6a-6701-4813-a7c1-d687d435417e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:13.735079 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-ad4d2c6a-6701-4813-a7c1-d687d435417e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:13.741295 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ad4d2c6a-6701-4813-a7c1-d687d435417e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:13.741772 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ad4d2c6a-6701-4813-a7c1-d687d435417e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:13.742210 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ad4d2c6a-6701-4813-a7c1-d687d435417e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:13.742895 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ad4d2c6a-6701-4813-a7c1-d687d435417e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:13.743345 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ad4d2c6a-6701-4813-a7c1-d687d435417e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:13.743766 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ad4d2c6a-6701-4813-a7c1-d687d435417e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:13.783484 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-b053aa33-6c61-4645-b0ca-e2339b4f9bc6 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:13.791328 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-b053aa33-6c61-4645-b0ca-e2339b4f9bc6 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1319 microversion: 2.1 time: 0.156980 Aug 24 07:59:13.791907 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 220/433] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:13 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:13.889115 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-ad4d2c6a-6701-4813-a7c1-d687d435417e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:13.899521 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-ad4d2c6a-6701-4813-a7c1-d687d435417e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:13.901102 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-ad4d2c6a-6701-4813-a7c1-d687d435417e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:13.902273 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-ad4d2c6a-6701-4813-a7c1-d687d435417e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.172772 Aug 24 07:59:13.902821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 214/434] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:59:13 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:59:14.825241 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-32c5653e-3123-4fb2-a4a5-a746e283be2e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:14.825857 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-32c5653e-3123-4fb2-a4a5-a746e283be2e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:14.832363 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-32c5653e-3123-4fb2-a4a5-a746e283be2e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:14.832887 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-32c5653e-3123-4fb2-a4a5-a746e283be2e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:14.833331 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-32c5653e-3123-4fb2-a4a5-a746e283be2e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:14.834019 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-32c5653e-3123-4fb2-a4a5-a746e283be2e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:14.834474 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-32c5653e-3123-4fb2-a4a5-a746e283be2e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:14.834899 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-32c5653e-3123-4fb2-a4a5-a746e283be2e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:14.926287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-f6c9b587-fa8d-4ee2-9f7c-c45f7799690a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:14.926894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-f6c9b587-fa8d-4ee2-9f7c-c45f7799690a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:14.929270 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:14.934467 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f6c9b587-fa8d-4ee2-9f7c-c45f7799690a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:14.934951 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f6c9b587-fa8d-4ee2-9f7c-c45f7799690a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:14.935467 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f6c9b587-fa8d-4ee2-9f7c-c45f7799690a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:14.936169 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f6c9b587-fa8d-4ee2-9f7c-c45f7799690a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:14.936620 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f6c9b587-fa8d-4ee2-9f7c-c45f7799690a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:14.937150 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f6c9b587-fa8d-4ee2-9f7c-c45f7799690a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:14.970372 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-32c5653e-3123-4fb2-a4a5-a746e283be2e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:14.978185 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-32c5653e-3123-4fb2-a4a5-a746e283be2e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1319 microversion: 2.1 time: 0.156746 Aug 24 07:59:14.978761 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 221/435] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:14 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:15.071626 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-f6c9b587-fa8d-4ee2-9f7c-c45f7799690a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:15.080365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-f6c9b587-fa8d-4ee2-9f7c-c45f7799690a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:15.081842 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-f6c9b587-fa8d-4ee2-9f7c-c45f7799690a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:15.083007 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-f6c9b587-fa8d-4ee2-9f7c-c45f7799690a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.160602 Aug 24 07:59:15.083557 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 215/436] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:59:14 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:59:15.999254 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-05831671-9cdd-49fc-8381-2e09127350ee tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:15.999866 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-05831671-9cdd-49fc-8381-2e09127350ee tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:16.006296 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-05831671-9cdd-49fc-8381-2e09127350ee tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:16.006775 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-05831671-9cdd-49fc-8381-2e09127350ee tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:16.007209 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-05831671-9cdd-49fc-8381-2e09127350ee tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:16.007895 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-05831671-9cdd-49fc-8381-2e09127350ee tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:16.008343 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-05831671-9cdd-49fc-8381-2e09127350ee tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:16.008811 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-05831671-9cdd-49fc-8381-2e09127350ee tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:16.106628 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e4d51f2d-857b-451e-92b1-b15fea5548bc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:16.107239 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-e4d51f2d-857b-451e-92b1-b15fea5548bc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:16.113632 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e4d51f2d-857b-451e-92b1-b15fea5548bc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:16.114113 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e4d51f2d-857b-451e-92b1-b15fea5548bc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:16.114546 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e4d51f2d-857b-451e-92b1-b15fea5548bc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:16.115243 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e4d51f2d-857b-451e-92b1-b15fea5548bc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:16.115910 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e4d51f2d-857b-451e-92b1-b15fea5548bc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:16.116335 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e4d51f2d-857b-451e-92b1-b15fea5548bc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:16.141865 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-05831671-9cdd-49fc-8381-2e09127350ee tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:16.149629 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-05831671-9cdd-49fc-8381-2e09127350ee tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1319 microversion: 2.1 time: 0.154729 Aug 24 07:59:16.150195 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 222/437] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:15 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:59:16.255698 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e4d51f2d-857b-451e-92b1-b15fea5548bc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:16.265169 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e4d51f2d-857b-451e-92b1-b15fea5548bc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:16.266679 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e4d51f2d-857b-451e-92b1-b15fea5548bc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:16.267849 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-e4d51f2d-857b-451e-92b1-b15fea5548bc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.165653 Aug 24 07:59:16.268405 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 216/438] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:59:16 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:59:17.171487 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-ec7127ae-fd15-49cf-b40a-681dcdc4a318 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:17.172095 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-ec7127ae-fd15-49cf-b40a-681dcdc4a318 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:17.178605 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ec7127ae-fd15-49cf-b40a-681dcdc4a318 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:17.179080 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ec7127ae-fd15-49cf-b40a-681dcdc4a318 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:17.179512 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ec7127ae-fd15-49cf-b40a-681dcdc4a318 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:17.180197 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ec7127ae-fd15-49cf-b40a-681dcdc4a318 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:17.180773 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ec7127ae-fd15-49cf-b40a-681dcdc4a318 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:17.181209 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ec7127ae-fd15-49cf-b40a-681dcdc4a318 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:17.291110 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-f490d818-ff4f-4825-b48f-c336cb527852 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:17.291943 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-f490d818-ff4f-4825-b48f-c336cb527852 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:17.299044 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f490d818-ff4f-4825-b48f-c336cb527852 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:17.299517 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f490d818-ff4f-4825-b48f-c336cb527852 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:17.299944 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f490d818-ff4f-4825-b48f-c336cb527852 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:17.300630 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f490d818-ff4f-4825-b48f-c336cb527852 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:17.301096 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f490d818-ff4f-4825-b48f-c336cb527852 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:17.301512 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f490d818-ff4f-4825-b48f-c336cb527852 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:17.308276 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-ec7127ae-fd15-49cf-b40a-681dcdc4a318 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:17.315959 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-ec7127ae-fd15-49cf-b40a-681dcdc4a318 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1319 microversion: 2.1 time: 0.148901 Aug 24 07:59:17.316520 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 223/439] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:17 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:17.433782 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-f490d818-ff4f-4825-b48f-c336cb527852 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:17.443866 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-f490d818-ff4f-4825-b48f-c336cb527852 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:17.444887 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-f490d818-ff4f-4825-b48f-c336cb527852 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:17.446053 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-f490d818-ff4f-4825-b48f-c336cb527852 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.158866 Aug 24 07:59:17.446899 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 217/440] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:59:17 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:59:18.337811 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-6939e11e-7ad1-4b69-835f-9cbffef9f092 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:18.338419 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-6939e11e-7ad1-4b69-835f-9cbffef9f092 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:18.344940 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6939e11e-7ad1-4b69-835f-9cbffef9f092 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:18.345421 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6939e11e-7ad1-4b69-835f-9cbffef9f092 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:18.345880 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6939e11e-7ad1-4b69-835f-9cbffef9f092 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:18.346569 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6939e11e-7ad1-4b69-835f-9cbffef9f092 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:18.347028 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6939e11e-7ad1-4b69-835f-9cbffef9f092 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:18.347450 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6939e11e-7ad1-4b69-835f-9cbffef9f092 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:18.472416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-afcf71ef-6706-4a13-8982-4a81e7228c52 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:18.472416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-afcf71ef-6706-4a13-8982-4a81e7228c52 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:18.482995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-afcf71ef-6706-4a13-8982-4a81e7228c52 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:18.483608 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-afcf71ef-6706-4a13-8982-4a81e7228c52 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:18.484128 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-afcf71ef-6706-4a13-8982-4a81e7228c52 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:18.485298 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-afcf71ef-6706-4a13-8982-4a81e7228c52 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:18.485820 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-afcf71ef-6706-4a13-8982-4a81e7228c52 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:18.486469 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-afcf71ef-6706-4a13-8982-4a81e7228c52 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:18.493391 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-6939e11e-7ad1-4b69-835f-9cbffef9f092 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:18.503530 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-6939e11e-7ad1-4b69-835f-9cbffef9f092 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1319 microversion: 2.1 time: 0.169340 Aug 24 07:59:18.513520 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 224/441] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:18 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:18.801513 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-afcf71ef-6706-4a13-8982-4a81e7228c52 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:18.801513 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-afcf71ef-6706-4a13-8982-4a81e7228c52 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:18.801750 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-afcf71ef-6706-4a13-8982-4a81e7228c52 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:18.801750 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-afcf71ef-6706-4a13-8982-4a81e7228c52 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1808 microversion: 2.20 time: 0.312873 Aug 24 07:59:18.801750 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 218/442] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:59:18 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1808 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:59:19.422117 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-f2a1c7dc-2ab7-4134-bc2d-8aa39855d4c8 req-6a665ce2-ccb7-48a4-bfcc-c9974c949ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c96a75be-6264-4548-aa5d-a893ca4ef99e", "tag": "2c78af22-1fab-4824-9791-0cc1b1431dc3"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:59:19.431823 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-f2a1c7dc-2ab7-4134-bc2d-8aa39855d4c8 req-6a665ce2-ccb7-48a4-bfcc-c9974c949ea5 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:19.432223 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-f2a1c7dc-2ab7-4134-bc2d-8aa39855d4c8 req-6a665ce2-ccb7-48a4-bfcc-c9974c949ea5 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:19.433230 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-f2a1c7dc-2ab7-4134-bc2d-8aa39855d4c8 req-6a665ce2-ccb7-48a4-bfcc-c9974c949ea5 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:19.445089 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-f2a1c7dc-2ab7-4134-bc2d-8aa39855d4c8 req-6a665ce2-ccb7-48a4-bfcc-c9974c949ea5 service nova] Creating event network-changed:2c78af22-1fab-4824-9791-0cc1b1431dc3 for instance c96a75be-6264-4548-aa5d-a893ca4ef99e on hv-cinder-85427 Aug 24 07:59:19.450194 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-f2a1c7dc-2ab7-4134-bc2d-8aa39855d4c8 req-6a665ce2-ccb7-48a4-bfcc-c9974c949ea5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031859 Aug 24 07:59:19.450773 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 225/443] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:59:19.525542 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-37283717-d54f-454a-8f31-ef5d667832cb tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:19.526150 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-37283717-d54f-454a-8f31-ef5d667832cb tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:19.532566 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-37283717-d54f-454a-8f31-ef5d667832cb tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:19.533352 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-37283717-d54f-454a-8f31-ef5d667832cb tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:19.533784 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-37283717-d54f-454a-8f31-ef5d667832cb tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:19.534477 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-37283717-d54f-454a-8f31-ef5d667832cb tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:19.534925 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-37283717-d54f-454a-8f31-ef5d667832cb tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:19.535346 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-37283717-d54f-454a-8f31-ef5d667832cb tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:19.553770 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=100 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:19.757495 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-37283717-d54f-454a-8f31-ef5d667832cb tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:19.767487 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-37283717-d54f-454a-8f31-ef5d667832cb tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1319 microversion: 2.1 time: 0.245651 Aug 24 07:59:19.768073 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 219/444] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:19 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:19.812971 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-0d466cc7-99e5-4830-bbcd-9ccb5793ac6e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:19.813795 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-0d466cc7-99e5-4830-bbcd-9ccb5793ac6e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:19.820179 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0d466cc7-99e5-4830-bbcd-9ccb5793ac6e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:19.820703 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0d466cc7-99e5-4830-bbcd-9ccb5793ac6e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:19.821353 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0d466cc7-99e5-4830-bbcd-9ccb5793ac6e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:19.822121 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0d466cc7-99e5-4830-bbcd-9ccb5793ac6e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:19.822647 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0d466cc7-99e5-4830-bbcd-9ccb5793ac6e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:19.823078 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0d466cc7-99e5-4830-bbcd-9ccb5793ac6e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:19.993714 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-0d466cc7-99e5-4830-bbcd-9ccb5793ac6e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:20.002790 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-0d466cc7-99e5-4830-bbcd-9ccb5793ac6e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:20.004315 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-0d466cc7-99e5-4830-bbcd-9ccb5793ac6e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:20.005595 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-0d466cc7-99e5-4830-bbcd-9ccb5793ac6e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1795 microversion: 2.20 time: 0.196944 Aug 24 07:59:20.006146 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 226/445] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:59:19 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1795 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:59:20.771312 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-fbece184-1c1e-461e-b7a3-b58149463752 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:59:20.773645 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-fbece184-1c1e-461e-b7a3-b58149463752 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:20.780921 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fbece184-1c1e-461e-b7a3-b58149463752 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:20.781406 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fbece184-1c1e-461e-b7a3-b58149463752 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:20.781847 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fbece184-1c1e-461e-b7a3-b58149463752 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:20.782544 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fbece184-1c1e-461e-b7a3-b58149463752 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:20.783302 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fbece184-1c1e-461e-b7a3-b58149463752 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:20.783733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fbece184-1c1e-461e-b7a3-b58149463752 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:20.789148 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-c08c1833-2751-4911-ada3-59a078796a1d tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:20.789770 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-c08c1833-2751-4911-ada3-59a078796a1d tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:20.797073 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c08c1833-2751-4911-ada3-59a078796a1d tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:20.797564 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c08c1833-2751-4911-ada3-59a078796a1d tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:20.798008 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c08c1833-2751-4911-ada3-59a078796a1d tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:20.798708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c08c1833-2751-4911-ada3-59a078796a1d tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:20.799898 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c08c1833-2751-4911-ada3-59a078796a1d tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:20.800364 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c08c1833-2751-4911-ada3-59a078796a1d tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:20.808746 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.objects.instance [None req-fbece184-1c1e-461e-b7a3-b58149463752 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lazy-loading 'flavor' on Instance uuid f31397ec-5acf-4a90-a500-280a47ed1f55 {{(pid=127589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:59:20.933902 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-c08c1833-2751-4911-ada3-59a078796a1d tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:20.941512 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-c08c1833-2751-4911-ada3-59a078796a1d tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1319 microversion: 2.1 time: 0.156184 Aug 24 07:59:20.942061 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 227/446] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:20 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:59:21.134054 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-fbece184-1c1e-461e-b7a3-b58149463752 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "POST /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55/action" status: 200 len: 32 microversion: 2.1 time: 0.366537 Aug 24 07:59:21.134829 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 220/447] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 24 07:59:20 2022] POST /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55/action => generated 32 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 07:59:21.144927 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-589231f2-6de8-4bf8-982a-d281e34f7e1a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:21.145538 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-589231f2-6de8-4bf8-982a-d281e34f7e1a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:21.147563 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:21.152357 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-589231f2-6de8-4bf8-982a-d281e34f7e1a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:21.152877 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-589231f2-6de8-4bf8-982a-d281e34f7e1a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:21.153312 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-589231f2-6de8-4bf8-982a-d281e34f7e1a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:21.153999 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-589231f2-6de8-4bf8-982a-d281e34f7e1a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:21.154501 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-589231f2-6de8-4bf8-982a-d281e34f7e1a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:21.154955 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-589231f2-6de8-4bf8-982a-d281e34f7e1a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:21.282547 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-589231f2-6de8-4bf8-982a-d281e34f7e1a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:21.290973 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-589231f2-6de8-4bf8-982a-d281e34f7e1a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1732 microversion: 2.1 time: 0.150067 Aug 24 07:59:21.291528 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 228/448] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:21 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:59:21.964624 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-91e4ff4d-9268-4e52-a860-5e35cbf830d5 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:21.965180 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-91e4ff4d-9268-4e52-a860-5e35cbf830d5 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:21.971414 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-91e4ff4d-9268-4e52-a860-5e35cbf830d5 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:21.971906 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-91e4ff4d-9268-4e52-a860-5e35cbf830d5 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:21.972382 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-91e4ff4d-9268-4e52-a860-5e35cbf830d5 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:21.973182 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-91e4ff4d-9268-4e52-a860-5e35cbf830d5 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:21.973638 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-91e4ff4d-9268-4e52-a860-5e35cbf830d5 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:21.974061 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-91e4ff4d-9268-4e52-a860-5e35cbf830d5 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:22.104627 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-91e4ff4d-9268-4e52-a860-5e35cbf830d5 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:22.112329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-91e4ff4d-9268-4e52-a860-5e35cbf830d5 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1319 microversion: 2.1 time: 0.153107 Aug 24 07:59:22.112957 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 221/449] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:21 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:22.312986 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-8de3d97e-98a6-49ed-9e8d-15b53bfb992f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:22.313597 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-8de3d97e-98a6-49ed-9e8d-15b53bfb992f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:22.319579 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8de3d97e-98a6-49ed-9e8d-15b53bfb992f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:22.320058 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8de3d97e-98a6-49ed-9e8d-15b53bfb992f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:22.320491 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8de3d97e-98a6-49ed-9e8d-15b53bfb992f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:22.321211 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8de3d97e-98a6-49ed-9e8d-15b53bfb992f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:22.321664 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8de3d97e-98a6-49ed-9e8d-15b53bfb992f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:22.322089 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8de3d97e-98a6-49ed-9e8d-15b53bfb992f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:22.339570 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=100 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:22.452147 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-8de3d97e-98a6-49ed-9e8d-15b53bfb992f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:22.460273 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-8de3d97e-98a6-49ed-9e8d-15b53bfb992f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1732 microversion: 2.1 time: 0.152168 Aug 24 07:59:22.460862 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 229/450] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:22 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:23.132380 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-ca28a249-13ea-4a95-9a88-f407b723ac1e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:23.133019 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-ca28a249-13ea-4a95-9a88-f407b723ac1e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:23.139488 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ca28a249-13ea-4a95-9a88-f407b723ac1e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:23.139962 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ca28a249-13ea-4a95-9a88-f407b723ac1e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:23.140391 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ca28a249-13ea-4a95-9a88-f407b723ac1e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:23.141123 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ca28a249-13ea-4a95-9a88-f407b723ac1e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:23.141570 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ca28a249-13ea-4a95-9a88-f407b723ac1e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:23.141989 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ca28a249-13ea-4a95-9a88-f407b723ac1e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:23.274139 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-ca28a249-13ea-4a95-9a88-f407b723ac1e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:23.282210 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-ca28a249-13ea-4a95-9a88-f407b723ac1e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1319 microversion: 2.1 time: 0.153656 Aug 24 07:59:23.283025 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 222/451] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:23 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:23.481529 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-f726525b-b57e-4e80-9135-f44d2c3d1a82 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:23.482135 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-f726525b-b57e-4e80-9135-f44d2c3d1a82 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:23.488590 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f726525b-b57e-4e80-9135-f44d2c3d1a82 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:23.489161 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f726525b-b57e-4e80-9135-f44d2c3d1a82 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:23.489589 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f726525b-b57e-4e80-9135-f44d2c3d1a82 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:23.490268 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f726525b-b57e-4e80-9135-f44d2c3d1a82 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:23.490709 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f726525b-b57e-4e80-9135-f44d2c3d1a82 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:23.491213 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f726525b-b57e-4e80-9135-f44d2c3d1a82 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:23.622918 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-f726525b-b57e-4e80-9135-f44d2c3d1a82 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:23.631053 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-f726525b-b57e-4e80-9135-f44d2c3d1a82 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1732 microversion: 2.1 time: 0.153496 Aug 24 07:59:23.631612 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 230/452] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:23 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:24.303554 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e8b30fdc-d5e5-4637-9442-5d57f3327f6e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:24.304170 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-e8b30fdc-d5e5-4637-9442-5d57f3327f6e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:24.311204 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e8b30fdc-d5e5-4637-9442-5d57f3327f6e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:24.311740 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e8b30fdc-d5e5-4637-9442-5d57f3327f6e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:24.312128 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e8b30fdc-d5e5-4637-9442-5d57f3327f6e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:24.312860 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e8b30fdc-d5e5-4637-9442-5d57f3327f6e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:24.313317 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e8b30fdc-d5e5-4637-9442-5d57f3327f6e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:24.313744 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e8b30fdc-d5e5-4637-9442-5d57f3327f6e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:24.462972 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e8b30fdc-d5e5-4637-9442-5d57f3327f6e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:24.471407 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-e8b30fdc-d5e5-4637-9442-5d57f3327f6e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1319 microversion: 2.1 time: 0.171735 Aug 24 07:59:24.471967 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 223/453] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:24 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:24.654343 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-b5a90931-bd6e-4203-9551-87ab09ce9f97 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:24.654963 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-b5a90931-bd6e-4203-9551-87ab09ce9f97 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:24.661724 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b5a90931-bd6e-4203-9551-87ab09ce9f97 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:24.665565 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b5a90931-bd6e-4203-9551-87ab09ce9f97 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:24.665565 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b5a90931-bd6e-4203-9551-87ab09ce9f97 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:24.665565 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b5a90931-bd6e-4203-9551-87ab09ce9f97 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:24.665565 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b5a90931-bd6e-4203-9551-87ab09ce9f97 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:24.666032 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b5a90931-bd6e-4203-9551-87ab09ce9f97 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:24.801023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-b5a90931-bd6e-4203-9551-87ab09ce9f97 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:24.810216 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-b5a90931-bd6e-4203-9551-87ab09ce9f97 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1732 microversion: 2.1 time: 0.160366 Aug 24 07:59:24.810780 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 231/454] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:24 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:25.492602 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-c0d62426-655e-44d1-896c-e85f3849ae12 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:25.496107 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-c0d62426-655e-44d1-896c-e85f3849ae12 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:25.500196 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c0d62426-655e-44d1-896c-e85f3849ae12 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:25.500704 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c0d62426-655e-44d1-896c-e85f3849ae12 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:25.501145 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c0d62426-655e-44d1-896c-e85f3849ae12 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:25.501879 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c0d62426-655e-44d1-896c-e85f3849ae12 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:25.502329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c0d62426-655e-44d1-896c-e85f3849ae12 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:25.502755 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c0d62426-655e-44d1-896c-e85f3849ae12 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:25.633213 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-c0d62426-655e-44d1-896c-e85f3849ae12 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:25.642261 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-c0d62426-655e-44d1-896c-e85f3849ae12 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1319 microversion: 2.1 time: 0.153486 Aug 24 07:59:25.643729 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 224/455] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:25 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:25.834195 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-db5187d9-40c4-4a9a-a2a0-588451fb81e0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:25.834800 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-db5187d9-40c4-4a9a-a2a0-588451fb81e0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:25.842214 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-db5187d9-40c4-4a9a-a2a0-588451fb81e0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:25.842368 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-db5187d9-40c4-4a9a-a2a0-588451fb81e0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:25.842736 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-db5187d9-40c4-4a9a-a2a0-588451fb81e0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:25.843476 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-db5187d9-40c4-4a9a-a2a0-588451fb81e0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:25.843874 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-db5187d9-40c4-4a9a-a2a0-588451fb81e0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:25.844562 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-db5187d9-40c4-4a9a-a2a0-588451fb81e0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:25.974925 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-db5187d9-40c4-4a9a-a2a0-588451fb81e0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:25.983206 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-db5187d9-40c4-4a9a-a2a0-588451fb81e0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1732 microversion: 2.1 time: 0.152895 Aug 24 07:59:25.983798 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 232/456] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:25 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:26.663638 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-3e20ae5b-4ab0-47be-9858-394c58cc33d4 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:26.664230 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-3e20ae5b-4ab0-47be-9858-394c58cc33d4 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:26.672075 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3e20ae5b-4ab0-47be-9858-394c58cc33d4 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:26.672555 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3e20ae5b-4ab0-47be-9858-394c58cc33d4 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:26.673035 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3e20ae5b-4ab0-47be-9858-394c58cc33d4 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:26.673765 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3e20ae5b-4ab0-47be-9858-394c58cc33d4 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:26.674199 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3e20ae5b-4ab0-47be-9858-394c58cc33d4 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:26.674623 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3e20ae5b-4ab0-47be-9858-394c58cc33d4 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:26.806466 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-3e20ae5b-4ab0-47be-9858-394c58cc33d4 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:26.814797 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-3e20ae5b-4ab0-47be-9858-394c58cc33d4 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1319 microversion: 2.1 time: 0.155362 Aug 24 07:59:26.815354 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 225/457] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:26 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:27.004203 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-f2aa6e98-e434-4dc2-afd1-679a7b5de139 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:27.004833 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-f2aa6e98-e434-4dc2-afd1-679a7b5de139 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:27.011698 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f2aa6e98-e434-4dc2-afd1-679a7b5de139 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:27.012168 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f2aa6e98-e434-4dc2-afd1-679a7b5de139 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:27.012624 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f2aa6e98-e434-4dc2-afd1-679a7b5de139 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:27.013328 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f2aa6e98-e434-4dc2-afd1-679a7b5de139 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:27.013772 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f2aa6e98-e434-4dc2-afd1-679a7b5de139 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:27.014190 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f2aa6e98-e434-4dc2-afd1-679a7b5de139 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:27.141336 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-f2aa6e98-e434-4dc2-afd1-679a7b5de139 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:27.149473 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-f2aa6e98-e434-4dc2-afd1-679a7b5de139 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1732 microversion: 2.1 time: 0.149064 Aug 24 07:59:27.150058 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 233/458] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:26 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:27.836736 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-9c1459a8-0486-4cfc-a85b-16b010ffdf1f tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:27.837380 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-9c1459a8-0486-4cfc-a85b-16b010ffdf1f tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:27.847996 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9c1459a8-0486-4cfc-a85b-16b010ffdf1f tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:27.848508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9c1459a8-0486-4cfc-a85b-16b010ffdf1f tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:27.848980 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9c1459a8-0486-4cfc-a85b-16b010ffdf1f tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:27.849691 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9c1459a8-0486-4cfc-a85b-16b010ffdf1f tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:27.850278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9c1459a8-0486-4cfc-a85b-16b010ffdf1f tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:27.851057 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9c1459a8-0486-4cfc-a85b-16b010ffdf1f tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:27.987829 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-9c1459a8-0486-4cfc-a85b-16b010ffdf1f tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:27.995684 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-9c1459a8-0486-4cfc-a85b-16b010ffdf1f tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1319 microversion: 2.1 time: 0.162823 Aug 24 07:59:28.007537 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 226/459] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:27 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:28.171652 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-2ba91652-7a4e-42da-b3e5-d871490fe16f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:28.172244 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-2ba91652-7a4e-42da-b3e5-d871490fe16f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:28.178400 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2ba91652-7a4e-42da-b3e5-d871490fe16f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:28.178888 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2ba91652-7a4e-42da-b3e5-d871490fe16f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:28.179326 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2ba91652-7a4e-42da-b3e5-d871490fe16f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:28.180026 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2ba91652-7a4e-42da-b3e5-d871490fe16f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:28.180488 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2ba91652-7a4e-42da-b3e5-d871490fe16f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:28.180940 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2ba91652-7a4e-42da-b3e5-d871490fe16f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:28.310126 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-2ba91652-7a4e-42da-b3e5-d871490fe16f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:28.318672 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-2ba91652-7a4e-42da-b3e5-d871490fe16f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1732 microversion: 2.1 time: 0.151208 Aug 24 07:59:28.319224 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 234/460] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:28 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:29.017879 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-d7ada2e0-4628-441c-8e8e-259dda3bc6e5 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:29.018347 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-d7ada2e0-4628-441c-8e8e-259dda3bc6e5 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:29.024765 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d7ada2e0-4628-441c-8e8e-259dda3bc6e5 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:29.025328 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d7ada2e0-4628-441c-8e8e-259dda3bc6e5 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:29.025890 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d7ada2e0-4628-441c-8e8e-259dda3bc6e5 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:29.026733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d7ada2e0-4628-441c-8e8e-259dda3bc6e5 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:29.027448 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d7ada2e0-4628-441c-8e8e-259dda3bc6e5 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:29.028094 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d7ada2e0-4628-441c-8e8e-259dda3bc6e5 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:29.112051 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-4c14d1fd-b8cf-4008-8e8f-fa98c74c9d1c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1151999074", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1957195615", "security_groups": [{"name": "tempest-secgroup-smoke-164184927"}], "networks": [{"uuid": "fd82724f-8179-4a88-b4ce-3be85f3e9585"}], "block_device_mapping_v2": [{"uuid": "c2fe5e4b-1639-49ea-9a61-647385167432", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:59:29.198598 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-d7ada2e0-4628-441c-8e8e-259dda3bc6e5 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:29.208310 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-d7ada2e0-4628-441c-8e8e-259dda3bc6e5 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1319 microversion: 2.1 time: 0.195082 Aug 24 07:59:29.209242 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 227/461] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:29 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:29.257862 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.network.neutron [None req-4c14d1fd-b8cf-4008-8e8f-fa98c74c9d1c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] validate_networks() for [('fd82724f-8179-4a88-b4ce-3be85f3e9585', None, None, None, None, None)] {{(pid=127590) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:59:29.344566 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-cdd8158f-f937-4175-b954-2b2c740490a0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:29.345446 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-cdd8158f-f937-4175-b954-2b2c740490a0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:29.358312 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cdd8158f-f937-4175-b954-2b2c740490a0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:29.358801 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cdd8158f-f937-4175-b954-2b2c740490a0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:29.359232 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cdd8158f-f937-4175-b954-2b2c740490a0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:29.361728 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cdd8158f-f937-4175-b954-2b2c740490a0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:29.362616 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cdd8158f-f937-4175-b954-2b2c740490a0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:29.363939 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cdd8158f-f937-4175-b954-2b2c740490a0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:29.551490 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-cdd8158f-f937-4175-b954-2b2c740490a0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:29.560576 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-cdd8158f-f937-4175-b954-2b2c740490a0 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1732 microversion: 2.1 time: 0.224666 Aug 24 07:59:29.561864 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 228/462] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:29 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1732 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:29.703782 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-4c14d1fd-b8cf-4008-8e8f-fa98c74c9d1c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Flavor limits 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:59:29.704202 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-4c14d1fd-b8cf-4008-8e8f-fa98c74c9d1c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Image limits 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:59:29.704706 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-4c14d1fd-b8cf-4008-8e8f-fa98c74c9d1c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Flavor pref 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:59:29.705168 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-4c14d1fd-b8cf-4008-8e8f-fa98c74c9d1c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Image pref 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:59:29.705623 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-4c14d1fd-b8cf-4008-8e8f-fa98c74c9d1c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:59:29.714790 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4c14d1fd-b8cf-4008-8e8f-fa98c74c9d1c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:29.715284 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4c14d1fd-b8cf-4008-8e8f-fa98c74c9d1c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:29.715725 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4c14d1fd-b8cf-4008-8e8f-fa98c74c9d1c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:29.716449 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4c14d1fd-b8cf-4008-8e8f-fa98c74c9d1c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:29.716923 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4c14d1fd-b8cf-4008-8e8f-fa98c74c9d1c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:29.717348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4c14d1fd-b8cf-4008-8e8f-fa98c74c9d1c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:29.735284 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-4c14d1fd-b8cf-4008-8e8f-fa98c74c9d1c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Getting quotas for project 576781ceab42470e9fd28a32ccb29e7f. Resources: {'cores', 'instances', 'ram'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:59:29.739576 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-4c14d1fd-b8cf-4008-8e8f-fa98c74c9d1c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Getting quotas for user 0ae325c8314c47a384a83509e3c281a0 and project 576781ceab42470e9fd28a32ccb29e7f. Resources: {'cores', 'instances', 'ram'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:59:29.798942 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-4c14d1fd-b8cf-4008-8e8f-fa98c74c9d1c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Going to run 1 instances... {{(pid=127590) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:59:29.801099 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-4c14d1fd-b8cf-4008-8e8f-fa98c74c9d1c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c2fe5e4b-1639-49ea-9a61-647385167432',volume_size=None,volume_type=None)] {{(pid=127590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:59:30.064370 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-c871c91a-93b7-492d-b6aa-498aa7a4a78d req-33026bbf-20d2-405e-9813-12d08495720e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c96a75be-6264-4548-aa5d-a893ca4ef99e", "name": "network-vif-plugged", "status": "completed", "tag": "2c78af22-1fab-4824-9791-0cc1b1431dc3"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:59:30.074453 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-c871c91a-93b7-492d-b6aa-498aa7a4a78d req-33026bbf-20d2-405e-9813-12d08495720e service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:30.074568 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-c871c91a-93b7-492d-b6aa-498aa7a4a78d req-33026bbf-20d2-405e-9813-12d08495720e service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:30.075040 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-c871c91a-93b7-492d-b6aa-498aa7a4a78d req-33026bbf-20d2-405e-9813-12d08495720e service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:30.086573 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-c871c91a-93b7-492d-b6aa-498aa7a4a78d req-33026bbf-20d2-405e-9813-12d08495720e service nova] Creating event network-vif-plugged:2c78af22-1fab-4824-9791-0cc1b1431dc3 for instance c96a75be-6264-4548-aa5d-a893ca4ef99e on hv-cinder-85427 Aug 24 07:59:30.094082 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-c871c91a-93b7-492d-b6aa-498aa7a4a78d req-33026bbf-20d2-405e-9813-12d08495720e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038354 Aug 24 07:59:30.094776 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 229/463] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:59:30.224709 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-4c14d1fd-b8cf-4008-8e8f-fa98c74c9d1c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.117338 Aug 24 07:59:30.225488 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 235/464] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 24 07:59:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 1119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 07:59:30.231797 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-5c4d2095-3e60-4f35-807e-e336cd9007ba tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:30.232770 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-5c4d2095-3e60-4f35-807e-e336cd9007ba tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:30.236727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-53ef35d8-6c1e-4e77-861c-291bc34d3fc3 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:30.237354 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-53ef35d8-6c1e-4e77-861c-291bc34d3fc3 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:30.240887 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c4d2095-3e60-4f35-807e-e336cd9007ba tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:30.241596 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c4d2095-3e60-4f35-807e-e336cd9007ba tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:30.243351 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c4d2095-3e60-4f35-807e-e336cd9007ba tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:30.244853 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c4d2095-3e60-4f35-807e-e336cd9007ba tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:30.246456 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c4d2095-3e60-4f35-807e-e336cd9007ba tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:30.246456 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c4d2095-3e60-4f35-807e-e336cd9007ba tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:30.320040 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-53ef35d8-6c1e-4e77-861c-291bc34d3fc3 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:30.329267 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-53ef35d8-6c1e-4e77-861c-291bc34d3fc3 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1089 microversion: 2.1 time: 0.096323 Aug 24 07:59:30.329822 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 236/465] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:30 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1089 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:59:30.474784 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-5c4d2095-3e60-4f35-807e-e336cd9007ba tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:30.484886 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-5c4d2095-3e60-4f35-807e-e336cd9007ba tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1319 microversion: 2.1 time: 0.257939 Aug 24 07:59:30.485733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 230/466] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:30 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:30.582062 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-daad8b43-cb54-4d8f-8ce6-54661be4ee55 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:30.582666 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-daad8b43-cb54-4d8f-8ce6-54661be4ee55 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:30.588856 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-daad8b43-cb54-4d8f-8ce6-54661be4ee55 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:30.590312 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-daad8b43-cb54-4d8f-8ce6-54661be4ee55 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:30.590312 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-daad8b43-cb54-4d8f-8ce6-54661be4ee55 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:30.590691 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-daad8b43-cb54-4d8f-8ce6-54661be4ee55 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:30.591084 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-daad8b43-cb54-4d8f-8ce6-54661be4ee55 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:30.591505 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-daad8b43-cb54-4d8f-8ce6-54661be4ee55 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:30.964849 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-daad8b43-cb54-4d8f-8ce6-54661be4ee55 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:30.973914 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-daad8b43-cb54-4d8f-8ce6-54661be4ee55 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1732 microversion: 2.1 time: 0.395685 Aug 24 07:59:30.981789 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 237/467] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:30 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1732 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:31.357057 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-52f41045-3ccc-40b3-84c7-81011945b3f6 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:31.357665 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-52f41045-3ccc-40b3-84c7-81011945b3f6 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:31.418044 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-52f41045-3ccc-40b3-84c7-81011945b3f6 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:31.425611 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-52f41045-3ccc-40b3-84c7-81011945b3f6 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1089 microversion: 2.1 time: 0.073563 Aug 24 07:59:31.426179 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 231/468] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:31 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1089 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:59:31.505989 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-a35f9bea-5356-4832-b70b-456c819bdb13 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:31.506606 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-a35f9bea-5356-4832-b70b-456c819bdb13 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:31.513541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a35f9bea-5356-4832-b70b-456c819bdb13 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:31.514141 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a35f9bea-5356-4832-b70b-456c819bdb13 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:31.514579 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a35f9bea-5356-4832-b70b-456c819bdb13 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:31.515269 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a35f9bea-5356-4832-b70b-456c819bdb13 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:31.515717 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a35f9bea-5356-4832-b70b-456c819bdb13 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:31.516249 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a35f9bea-5356-4832-b70b-456c819bdb13 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:31.724544 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-a35f9bea-5356-4832-b70b-456c819bdb13 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:31.733146 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-a35f9bea-5356-4832-b70b-456c819bdb13 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1319 microversion: 2.1 time: 0.230968 Aug 24 07:59:31.734087 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 238/469] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:31 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:31.996016 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-fb56b4e3-ba83-4da7-bcdf-641fea002584 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:31.996671 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-fb56b4e3-ba83-4da7-bcdf-641fea002584 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:32.003035 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fb56b4e3-ba83-4da7-bcdf-641fea002584 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:32.003526 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fb56b4e3-ba83-4da7-bcdf-641fea002584 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:32.003965 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fb56b4e3-ba83-4da7-bcdf-641fea002584 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:32.004666 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fb56b4e3-ba83-4da7-bcdf-641fea002584 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:32.005180 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fb56b4e3-ba83-4da7-bcdf-641fea002584 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:32.005610 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fb56b4e3-ba83-4da7-bcdf-641fea002584 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:32.149202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-fb56b4e3-ba83-4da7-bcdf-641fea002584 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:32.159675 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-fb56b4e3-ba83-4da7-bcdf-641fea002584 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1732 microversion: 2.1 time: 0.167496 Aug 24 07:59:32.160248 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 232/470] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:31 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:32.446029 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-f30c9832-07be-4855-8417-b9e997279948 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:32.446640 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-f30c9832-07be-4855-8417-b9e997279948 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:32.452840 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f30c9832-07be-4855-8417-b9e997279948 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:32.453322 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f30c9832-07be-4855-8417-b9e997279948 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:32.453757 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f30c9832-07be-4855-8417-b9e997279948 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:32.454449 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f30c9832-07be-4855-8417-b9e997279948 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:32.454901 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f30c9832-07be-4855-8417-b9e997279948 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:32.455325 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f30c9832-07be-4855-8417-b9e997279948 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:32.517359 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-f30c9832-07be-4855-8417-b9e997279948 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:32.525247 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-f30c9832-07be-4855-8417-b9e997279948 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1131 microversion: 2.1 time: 0.083159 Aug 24 07:59:32.526036 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 239/471] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:32 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1131 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:32.754437 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e467ec03-744e-46cb-9012-3cee740379b0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:32.755628 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-e467ec03-744e-46cb-9012-3cee740379b0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:32.763134 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e467ec03-744e-46cb-9012-3cee740379b0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:32.763880 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e467ec03-744e-46cb-9012-3cee740379b0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:32.764488 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e467ec03-744e-46cb-9012-3cee740379b0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:32.765237 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e467ec03-744e-46cb-9012-3cee740379b0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:32.765691 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e467ec03-744e-46cb-9012-3cee740379b0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:32.766244 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e467ec03-744e-46cb-9012-3cee740379b0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:32.905165 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e467ec03-744e-46cb-9012-3cee740379b0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:32.914181 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-e467ec03-744e-46cb-9012-3cee740379b0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1507 microversion: 2.1 time: 0.163709 Aug 24 07:59:32.915626 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 233/472] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:32 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:33.184596 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-4e814504-a656-474e-b5d9-015784239342 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:33.185951 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-4e814504-a656-474e-b5d9-015784239342 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:33.194450 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4e814504-a656-474e-b5d9-015784239342 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:33.196770 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4e814504-a656-474e-b5d9-015784239342 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:33.197454 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4e814504-a656-474e-b5d9-015784239342 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:33.199463 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4e814504-a656-474e-b5d9-015784239342 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:33.200989 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4e814504-a656-474e-b5d9-015784239342 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:33.201648 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4e814504-a656-474e-b5d9-015784239342 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:33.400528 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-4e814504-a656-474e-b5d9-015784239342 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:33.415483 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-4e814504-a656-474e-b5d9-015784239342 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1732 microversion: 2.1 time: 0.236040 Aug 24 07:59:33.422002 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 240/473] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:33 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1732 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:33.554995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-47d0181b-35ff-4d6b-b7e7-eea4f9756f2c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:33.555613 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-47d0181b-35ff-4d6b-b7e7-eea4f9756f2c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:33.568251 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-47d0181b-35ff-4d6b-b7e7-eea4f9756f2c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:33.569342 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-47d0181b-35ff-4d6b-b7e7-eea4f9756f2c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:33.569996 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-47d0181b-35ff-4d6b-b7e7-eea4f9756f2c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:33.570901 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-47d0181b-35ff-4d6b-b7e7-eea4f9756f2c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:33.571547 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-47d0181b-35ff-4d6b-b7e7-eea4f9756f2c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:33.572157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-47d0181b-35ff-4d6b-b7e7-eea4f9756f2c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:33.690598 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-47d0181b-35ff-4d6b-b7e7-eea4f9756f2c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:33.698886 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-47d0181b-35ff-4d6b-b7e7-eea4f9756f2c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1205 microversion: 2.1 time: 0.156510 Aug 24 07:59:33.699849 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 234/474] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:33 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1205 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:34.440003 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-cea2cb1e-c22d-4367-9b28-387787d355ea tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:34.441415 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-cea2cb1e-c22d-4367-9b28-387787d355ea tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:34.473484 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cea2cb1e-c22d-4367-9b28-387787d355ea tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:34.473484 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cea2cb1e-c22d-4367-9b28-387787d355ea tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:34.473484 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cea2cb1e-c22d-4367-9b28-387787d355ea tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:34.473484 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cea2cb1e-c22d-4367-9b28-387787d355ea tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:34.474711 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cea2cb1e-c22d-4367-9b28-387787d355ea tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:34.474711 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cea2cb1e-c22d-4367-9b28-387787d355ea tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:34.721337 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-3850edaf-26f4-4f77-8d39-b896bcc74bc5 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:34.722685 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-3850edaf-26f4-4f77-8d39-b896bcc74bc5 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:34.735048 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3850edaf-26f4-4f77-8d39-b896bcc74bc5 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:34.738035 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3850edaf-26f4-4f77-8d39-b896bcc74bc5 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:34.739637 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3850edaf-26f4-4f77-8d39-b896bcc74bc5 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:34.740636 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3850edaf-26f4-4f77-8d39-b896bcc74bc5 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:34.741324 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3850edaf-26f4-4f77-8d39-b896bcc74bc5 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:34.741986 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3850edaf-26f4-4f77-8d39-b896bcc74bc5 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:34.770354 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-cea2cb1e-c22d-4367-9b28-387787d355ea tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:34.794911 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-cea2cb1e-c22d-4367-9b28-387787d355ea tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1732 microversion: 2.1 time: 0.349005 Aug 24 07:59:34.795932 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 241/475] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:34 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1732 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:35.026305 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-3850edaf-26f4-4f77-8d39-b896bcc74bc5 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:35.035225 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:35.048772 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-3850edaf-26f4-4f77-8d39-b896bcc74bc5 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1272 microversion: 2.1 time: 0.331821 Aug 24 07:59:35.052854 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 235/476] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:34 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1272 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:35.746110 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-6067d723-3c2c-4685-ac50-c74199d44e18 req-57f96160-3f5e-4d79-993f-d6dd1ed82a28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ce799f4-91d9-4521-af5d-63757a11823c", "tag": "b6e8c168-af88-483f-9e17-53d9c3c9d376"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:59:35.774087 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-6067d723-3c2c-4685-ac50-c74199d44e18 req-57f96160-3f5e-4d79-993f-d6dd1ed82a28 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:35.779616 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-6067d723-3c2c-4685-ac50-c74199d44e18 req-57f96160-3f5e-4d79-993f-d6dd1ed82a28 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:35.780357 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-6067d723-3c2c-4685-ac50-c74199d44e18 req-57f96160-3f5e-4d79-993f-d6dd1ed82a28 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:35.825343 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-c69bde06-ad07-4c4b-9715-5ddec8b28e3b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:35.825343 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-c69bde06-ad07-4c4b-9715-5ddec8b28e3b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:35.834767 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-6067d723-3c2c-4685-ac50-c74199d44e18 req-57f96160-3f5e-4d79-993f-d6dd1ed82a28 service nova] Creating event network-changed:b6e8c168-af88-483f-9e17-53d9c3c9d376 for instance 3ce799f4-91d9-4521-af5d-63757a11823c on hv-cinder-85427 Aug 24 07:59:35.854607 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c69bde06-ad07-4c4b-9715-5ddec8b28e3b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:35.856373 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-6067d723-3c2c-4685-ac50-c74199d44e18 req-57f96160-3f5e-4d79-993f-d6dd1ed82a28 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115988 Aug 24 07:59:35.856605 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c69bde06-ad07-4c4b-9715-5ddec8b28e3b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:35.857165 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c69bde06-ad07-4c4b-9715-5ddec8b28e3b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:35.857752 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 242/477] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:59:35.866454 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c69bde06-ad07-4c4b-9715-5ddec8b28e3b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:35.867312 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c69bde06-ad07-4c4b-9715-5ddec8b28e3b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:35.868999 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c69bde06-ad07-4c4b-9715-5ddec8b28e3b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:36.076248 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-3e8a28f6-91f4-40f3-9942-54e4e9bac098 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:36.076975 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-3e8a28f6-91f4-40f3-9942-54e4e9bac098 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:36.085165 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3e8a28f6-91f4-40f3-9942-54e4e9bac098 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:36.086140 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3e8a28f6-91f4-40f3-9942-54e4e9bac098 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:36.086736 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3e8a28f6-91f4-40f3-9942-54e4e9bac098 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:36.087679 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3e8a28f6-91f4-40f3-9942-54e4e9bac098 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:36.088305 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3e8a28f6-91f4-40f3-9942-54e4e9bac098 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:36.092421 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-c69bde06-ad07-4c4b-9715-5ddec8b28e3b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:36.096174 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3e8a28f6-91f4-40f3-9942-54e4e9bac098 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:36.102017 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-c69bde06-ad07-4c4b-9715-5ddec8b28e3b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1732 microversion: 2.1 time: 0.286698 Aug 24 07:59:36.107858 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 236/478] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:35 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1732 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:36.423538 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-3e8a28f6-91f4-40f3-9942-54e4e9bac098 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:36.438667 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-3e8a28f6-91f4-40f3-9942-54e4e9bac098 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1260 microversion: 2.1 time: 0.368919 Aug 24 07:59:36.452154 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 243/479] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:36 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1260 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:59:37.131627 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-f1b8f0a6-5f53-4af4-a6a3-5d9bb84ed006 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:37.133201 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-f1b8f0a6-5f53-4af4-a6a3-5d9bb84ed006 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:37.141927 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f1b8f0a6-5f53-4af4-a6a3-5d9bb84ed006 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:37.142566 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f1b8f0a6-5f53-4af4-a6a3-5d9bb84ed006 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:37.143134 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f1b8f0a6-5f53-4af4-a6a3-5d9bb84ed006 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:37.144323 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f1b8f0a6-5f53-4af4-a6a3-5d9bb84ed006 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:37.145069 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f1b8f0a6-5f53-4af4-a6a3-5d9bb84ed006 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:37.145833 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f1b8f0a6-5f53-4af4-a6a3-5d9bb84ed006 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:37.419249 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-f1b8f0a6-5f53-4af4-a6a3-5d9bb84ed006 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:37.435954 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-f1b8f0a6-5f53-4af4-a6a3-5d9bb84ed006 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1732 microversion: 2.1 time: 0.307905 Aug 24 07:59:37.437195 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 237/480] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:37 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1732 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:37.465732 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-b8edeeea-72f7-4cee-985a-e68b03aa73b4 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:37.471379 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-b8edeeea-72f7-4cee-985a-e68b03aa73b4 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:37.475269 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b8edeeea-72f7-4cee-985a-e68b03aa73b4 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:37.475754 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b8edeeea-72f7-4cee-985a-e68b03aa73b4 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:37.476191 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b8edeeea-72f7-4cee-985a-e68b03aa73b4 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:37.476997 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b8edeeea-72f7-4cee-985a-e68b03aa73b4 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:37.477625 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b8edeeea-72f7-4cee-985a-e68b03aa73b4 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:37.478056 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b8edeeea-72f7-4cee-985a-e68b03aa73b4 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:37.763643 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-b8edeeea-72f7-4cee-985a-e68b03aa73b4 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:37.771660 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-b8edeeea-72f7-4cee-985a-e68b03aa73b4 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1260 microversion: 2.1 time: 0.310266 Aug 24 07:59:37.772496 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 244/481] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:37 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1260 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:38.463601 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-d7d38688-cce3-4488-8b22-a20c8c40dee4 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:38.467765 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-d7d38688-cce3-4488-8b22-a20c8c40dee4 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:38.486907 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d7d38688-cce3-4488-8b22-a20c8c40dee4 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:38.488059 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d7d38688-cce3-4488-8b22-a20c8c40dee4 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:38.497482 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d7d38688-cce3-4488-8b22-a20c8c40dee4 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:38.497482 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d7d38688-cce3-4488-8b22-a20c8c40dee4 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:38.497482 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d7d38688-cce3-4488-8b22-a20c8c40dee4 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:38.497482 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d7d38688-cce3-4488-8b22-a20c8c40dee4 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:38.711528 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-d7d38688-cce3-4488-8b22-a20c8c40dee4 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:38.720339 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-d7d38688-cce3-4488-8b22-a20c8c40dee4 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1732 microversion: 2.1 time: 0.261117 Aug 24 07:59:38.720945 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 238/482] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:38 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1732 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:38.794401 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-ef6aacde-275c-4fad-97ba-74f9d993a370 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:38.795833 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-ef6aacde-275c-4fad-97ba-74f9d993a370 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:38.803615 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ef6aacde-275c-4fad-97ba-74f9d993a370 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:38.804378 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ef6aacde-275c-4fad-97ba-74f9d993a370 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:38.805489 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ef6aacde-275c-4fad-97ba-74f9d993a370 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:38.806284 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ef6aacde-275c-4fad-97ba-74f9d993a370 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:38.806816 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ef6aacde-275c-4fad-97ba-74f9d993a370 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:38.807301 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ef6aacde-275c-4fad-97ba-74f9d993a370 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:38.983719 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-ef6aacde-275c-4fad-97ba-74f9d993a370 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:38.991938 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-ef6aacde-275c-4fad-97ba-74f9d993a370 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1260 microversion: 2.1 time: 0.202054 Aug 24 07:59:38.994532 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 245/483] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:38 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1260 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:39.749687 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-3c7748e1-9d79-4f95-bbd6-dbabc6f40802 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:39.750931 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-3c7748e1-9d79-4f95-bbd6-dbabc6f40802 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:39.774351 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3c7748e1-9d79-4f95-bbd6-dbabc6f40802 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:39.775109 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3c7748e1-9d79-4f95-bbd6-dbabc6f40802 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:39.775556 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3c7748e1-9d79-4f95-bbd6-dbabc6f40802 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:39.776449 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3c7748e1-9d79-4f95-bbd6-dbabc6f40802 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:39.781095 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3c7748e1-9d79-4f95-bbd6-dbabc6f40802 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:39.781556 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3c7748e1-9d79-4f95-bbd6-dbabc6f40802 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:39.939147 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-3c7748e1-9d79-4f95-bbd6-dbabc6f40802 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:39.951202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-3c7748e1-9d79-4f95-bbd6-dbabc6f40802 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1732 microversion: 2.1 time: 0.209609 Aug 24 07:59:39.952696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 239/484] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:39 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1732 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:40.014259 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-06a7bf38-3c20-48cc-ba9e-e13d222755eb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:40.014929 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-06a7bf38-3c20-48cc-ba9e-e13d222755eb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:40.017181 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=2 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:40.024005 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-06a7bf38-3c20-48cc-ba9e-e13d222755eb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:40.024403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-06a7bf38-3c20-48cc-ba9e-e13d222755eb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:40.025067 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-06a7bf38-3c20-48cc-ba9e-e13d222755eb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:40.025778 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-06a7bf38-3c20-48cc-ba9e-e13d222755eb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:40.026229 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-06a7bf38-3c20-48cc-ba9e-e13d222755eb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:40.026661 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-06a7bf38-3c20-48cc-ba9e-e13d222755eb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:40.231614 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-06a7bf38-3c20-48cc-ba9e-e13d222755eb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:40.239737 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-06a7bf38-3c20-48cc-ba9e-e13d222755eb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1260 microversion: 2.1 time: 0.229965 Aug 24 07:59:40.240303 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 246/485] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:40 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1260 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:40.975228 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-6425894f-7e8b-41ab-a063-b1cffa9ad63f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:40.976982 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-6425894f-7e8b-41ab-a063-b1cffa9ad63f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:40.986256 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6425894f-7e8b-41ab-a063-b1cffa9ad63f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:40.987195 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6425894f-7e8b-41ab-a063-b1cffa9ad63f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:40.988049 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6425894f-7e8b-41ab-a063-b1cffa9ad63f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:40.989109 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6425894f-7e8b-41ab-a063-b1cffa9ad63f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:40.989729 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6425894f-7e8b-41ab-a063-b1cffa9ad63f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:40.992529 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6425894f-7e8b-41ab-a063-b1cffa9ad63f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:41.154395 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-6425894f-7e8b-41ab-a063-b1cffa9ad63f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:41.164757 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-6425894f-7e8b-41ab-a063-b1cffa9ad63f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1732 microversion: 2.1 time: 0.193977 Aug 24 07:59:41.165515 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 240/486] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:40 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1732 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:41.265373 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-1cfcdc1c-c56d-429d-912c-86630500a5fb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:41.267204 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-1cfcdc1c-c56d-429d-912c-86630500a5fb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:41.278673 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=8 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:41.280967 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1cfcdc1c-c56d-429d-912c-86630500a5fb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:41.281459 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1cfcdc1c-c56d-429d-912c-86630500a5fb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:41.289129 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1cfcdc1c-c56d-429d-912c-86630500a5fb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:41.289947 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1cfcdc1c-c56d-429d-912c-86630500a5fb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:41.290761 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1cfcdc1c-c56d-429d-912c-86630500a5fb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:41.290869 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1cfcdc1c-c56d-429d-912c-86630500a5fb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:41.575149 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-1cfcdc1c-c56d-429d-912c-86630500a5fb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:41.587472 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-1cfcdc1c-c56d-429d-912c-86630500a5fb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1260 microversion: 2.1 time: 0.331066 Aug 24 07:59:41.597870 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 247/487] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:41 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1260 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:42.187694 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e5178dd7-df59-4b17-9d83-78f05aa59064 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:42.188274 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-e5178dd7-df59-4b17-9d83-78f05aa59064 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:42.190141 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=2 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:42.195390 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e5178dd7-df59-4b17-9d83-78f05aa59064 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:42.195880 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e5178dd7-df59-4b17-9d83-78f05aa59064 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:42.196322 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e5178dd7-df59-4b17-9d83-78f05aa59064 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:42.197046 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e5178dd7-df59-4b17-9d83-78f05aa59064 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:42.197504 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e5178dd7-df59-4b17-9d83-78f05aa59064 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:42.197930 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e5178dd7-df59-4b17-9d83-78f05aa59064 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:42.336570 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e5178dd7-df59-4b17-9d83-78f05aa59064 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:42.344949 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-e5178dd7-df59-4b17-9d83-78f05aa59064 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1732 microversion: 2.1 time: 0.161261 Aug 24 07:59:42.345606 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 241/488] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:42 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:42.614396 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-fa758d26-672a-4fec-9f6d-7774a76d231d tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:42.615180 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-fa758d26-672a-4fec-9f6d-7774a76d231d tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:42.623459 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fa758d26-672a-4fec-9f6d-7774a76d231d tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:42.624433 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fa758d26-672a-4fec-9f6d-7774a76d231d tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:42.625249 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fa758d26-672a-4fec-9f6d-7774a76d231d tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:42.626247 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fa758d26-672a-4fec-9f6d-7774a76d231d tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:42.626913 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fa758d26-672a-4fec-9f6d-7774a76d231d tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:42.627523 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fa758d26-672a-4fec-9f6d-7774a76d231d tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:42.646637 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=100 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:42.783930 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-fa758d26-672a-4fec-9f6d-7774a76d231d tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:42.797394 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-fa758d26-672a-4fec-9f6d-7774a76d231d tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1260 microversion: 2.1 time: 0.189570 Aug 24 07:59:42.798173 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 248/489] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:42 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:43.368645 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-c77cce83-d65f-44fc-8696-11eafa1fb8dc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:43.369415 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-c77cce83-d65f-44fc-8696-11eafa1fb8dc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:43.386995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c77cce83-d65f-44fc-8696-11eafa1fb8dc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:43.388473 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c77cce83-d65f-44fc-8696-11eafa1fb8dc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:43.389285 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c77cce83-d65f-44fc-8696-11eafa1fb8dc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:43.392100 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c77cce83-d65f-44fc-8696-11eafa1fb8dc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:43.395154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c77cce83-d65f-44fc-8696-11eafa1fb8dc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:43.396606 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c77cce83-d65f-44fc-8696-11eafa1fb8dc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:43.591345 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-c77cce83-d65f-44fc-8696-11eafa1fb8dc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:43.605095 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-c77cce83-d65f-44fc-8696-11eafa1fb8dc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1732 microversion: 2.1 time: 0.241987 Aug 24 07:59:43.617231 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 242/490] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:43 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1732 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:43.818596 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-e3f6f032-67fb-4629-9f36-1306279b4a0d tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:43.819396 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-e3f6f032-67fb-4629-9f36-1306279b4a0d tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:43.828006 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e3f6f032-67fb-4629-9f36-1306279b4a0d tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:43.828886 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e3f6f032-67fb-4629-9f36-1306279b4a0d tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:43.829414 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e3f6f032-67fb-4629-9f36-1306279b4a0d tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:43.830241 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e3f6f032-67fb-4629-9f36-1306279b4a0d tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:43.830789 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e3f6f032-67fb-4629-9f36-1306279b4a0d tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:43.831328 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e3f6f032-67fb-4629-9f36-1306279b4a0d tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:44.048257 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-e3f6f032-67fb-4629-9f36-1306279b4a0d tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:44.056895 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-e3f6f032-67fb-4629-9f36-1306279b4a0d tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1260 microversion: 2.1 time: 0.242425 Aug 24 07:59:44.057651 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 249/491] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:43 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1260 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:44.628949 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-86762b2b-eb06-40fb-a521-529a427af103 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:44.629564 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-86762b2b-eb06-40fb-a521-529a427af103 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:44.637725 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-86762b2b-eb06-40fb-a521-529a427af103 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:44.638404 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-86762b2b-eb06-40fb-a521-529a427af103 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:44.639252 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-86762b2b-eb06-40fb-a521-529a427af103 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:44.640140 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-86762b2b-eb06-40fb-a521-529a427af103 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:44.640826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-86762b2b-eb06-40fb-a521-529a427af103 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:44.641467 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-86762b2b-eb06-40fb-a521-529a427af103 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:44.828419 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-86762b2b-eb06-40fb-a521-529a427af103 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:44.843191 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-86762b2b-eb06-40fb-a521-529a427af103 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1732 microversion: 2.1 time: 0.218243 Aug 24 07:59:44.844556 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 243/492] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:44 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1732 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:45.080255 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-3f6110f1-f107-4002-8eea-795ffc961e55 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:45.081548 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-3f6110f1-f107-4002-8eea-795ffc961e55 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:45.088713 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3f6110f1-f107-4002-8eea-795ffc961e55 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:45.089216 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3f6110f1-f107-4002-8eea-795ffc961e55 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:45.089650 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3f6110f1-f107-4002-8eea-795ffc961e55 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:45.091349 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3f6110f1-f107-4002-8eea-795ffc961e55 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:45.092005 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3f6110f1-f107-4002-8eea-795ffc961e55 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:45.092586 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3f6110f1-f107-4002-8eea-795ffc961e55 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:45.389844 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-3f6110f1-f107-4002-8eea-795ffc961e55 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:45.397864 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-3f6110f1-f107-4002-8eea-795ffc961e55 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1260 microversion: 2.1 time: 0.323323 Aug 24 07:59:45.416379 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 250/493] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:45 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1260 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:45.873653 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-6feec0ea-b052-4692-a752-ff35fca95a6f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:45.874165 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-6feec0ea-b052-4692-a752-ff35fca95a6f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:45.882101 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=60 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:45.884643 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6feec0ea-b052-4692-a752-ff35fca95a6f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:45.885327 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6feec0ea-b052-4692-a752-ff35fca95a6f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:45.886186 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6feec0ea-b052-4692-a752-ff35fca95a6f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:45.887213 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6feec0ea-b052-4692-a752-ff35fca95a6f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:45.887678 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6feec0ea-b052-4692-a752-ff35fca95a6f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:45.888105 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6feec0ea-b052-4692-a752-ff35fca95a6f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:46.049795 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-6feec0ea-b052-4692-a752-ff35fca95a6f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:46.060087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-6feec0ea-b052-4692-a752-ff35fca95a6f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1732 microversion: 2.1 time: 0.194130 Aug 24 07:59:46.060692 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 244/494] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:45 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1732 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:59:46.420676 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-61ffd71c-d351-48d2-8af1-d33fe5c0f733 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:46.421390 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-61ffd71c-d351-48d2-8af1-d33fe5c0f733 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:46.430295 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-61ffd71c-d351-48d2-8af1-d33fe5c0f733 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:46.430789 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-61ffd71c-d351-48d2-8af1-d33fe5c0f733 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:46.431228 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-61ffd71c-d351-48d2-8af1-d33fe5c0f733 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:46.431942 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-61ffd71c-d351-48d2-8af1-d33fe5c0f733 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:46.432396 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-61ffd71c-d351-48d2-8af1-d33fe5c0f733 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:46.432909 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-61ffd71c-d351-48d2-8af1-d33fe5c0f733 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:46.587920 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-61ffd71c-d351-48d2-8af1-d33fe5c0f733 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:46.601599 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-61ffd71c-d351-48d2-8af1-d33fe5c0f733 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1260 microversion: 2.1 time: 0.185541 Aug 24 07:59:46.617109 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 251/495] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:46 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1260 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:47.083480 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-c19fa3a2-b72d-41aa-a7b8-233e497c8188 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:47.084746 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-c19fa3a2-b72d-41aa-a7b8-233e497c8188 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:47.091878 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c19fa3a2-b72d-41aa-a7b8-233e497c8188 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:47.092375 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c19fa3a2-b72d-41aa-a7b8-233e497c8188 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:47.092851 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c19fa3a2-b72d-41aa-a7b8-233e497c8188 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:47.093559 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c19fa3a2-b72d-41aa-a7b8-233e497c8188 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:47.094018 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c19fa3a2-b72d-41aa-a7b8-233e497c8188 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:47.094446 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c19fa3a2-b72d-41aa-a7b8-233e497c8188 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:47.274712 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-c19fa3a2-b72d-41aa-a7b8-233e497c8188 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:47.285009 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-c19fa3a2-b72d-41aa-a7b8-233e497c8188 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1732 microversion: 2.1 time: 0.205437 Aug 24 07:59:47.286087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 245/496] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:47 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1732 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:47.627920 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-a0ec4d24-4d13-4dbb-a3fe-3b2004902eb0 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:47.629248 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-a0ec4d24-4d13-4dbb-a3fe-3b2004902eb0 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:47.635915 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a0ec4d24-4d13-4dbb-a3fe-3b2004902eb0 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:47.636398 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a0ec4d24-4d13-4dbb-a3fe-3b2004902eb0 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:47.636906 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a0ec4d24-4d13-4dbb-a3fe-3b2004902eb0 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:47.637605 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a0ec4d24-4d13-4dbb-a3fe-3b2004902eb0 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:47.638251 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a0ec4d24-4d13-4dbb-a3fe-3b2004902eb0 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:47.638922 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a0ec4d24-4d13-4dbb-a3fe-3b2004902eb0 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:47.800113 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-a0ec4d24-4d13-4dbb-a3fe-3b2004902eb0 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:47.808237 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-a0ec4d24-4d13-4dbb-a3fe-3b2004902eb0 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1260 microversion: 2.1 time: 0.187415 Aug 24 07:59:47.809232 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 252/497] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:47 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:48.214685 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-281d5ad8-9052-40c7-a630-6f17195e1cb1 req-7ec4137c-33c4-4ead-b11c-1fe2b2346dfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce799f4-91d9-4521-af5d-63757a11823c", "name": "network-vif-plugged", "status": "completed", "tag": "b6e8c168-af88-483f-9e17-53d9c3c9d376"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:59:48.226695 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-281d5ad8-9052-40c7-a630-6f17195e1cb1 req-7ec4137c-33c4-4ead-b11c-1fe2b2346dfa service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:48.227170 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-281d5ad8-9052-40c7-a630-6f17195e1cb1 req-7ec4137c-33c4-4ead-b11c-1fe2b2346dfa service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:48.227752 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-281d5ad8-9052-40c7-a630-6f17195e1cb1 req-7ec4137c-33c4-4ead-b11c-1fe2b2346dfa service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:48.243657 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-281d5ad8-9052-40c7-a630-6f17195e1cb1 req-7ec4137c-33c4-4ead-b11c-1fe2b2346dfa service nova] Creating event network-vif-plugged:b6e8c168-af88-483f-9e17-53d9c3c9d376 for instance 3ce799f4-91d9-4521-af5d-63757a11823c on hv-cinder-85427 Aug 24 07:59:48.249340 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-281d5ad8-9052-40c7-a630-6f17195e1cb1 req-7ec4137c-33c4-4ead-b11c-1fe2b2346dfa service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038372 Aug 24 07:59:48.250369 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 246/498] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:59:48.307383 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-ee0017ed-bfc5-445b-8a31-c4e217c4ac25 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:48.308150 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-ee0017ed-bfc5-445b-8a31-c4e217c4ac25 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:48.326350 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ee0017ed-bfc5-445b-8a31-c4e217c4ac25 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:48.327754 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ee0017ed-bfc5-445b-8a31-c4e217c4ac25 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:48.329039 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ee0017ed-bfc5-445b-8a31-c4e217c4ac25 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:48.329945 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ee0017ed-bfc5-445b-8a31-c4e217c4ac25 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:48.330610 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ee0017ed-bfc5-445b-8a31-c4e217c4ac25 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:48.331202 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ee0017ed-bfc5-445b-8a31-c4e217c4ac25 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:48.523224 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-ee0017ed-bfc5-445b-8a31-c4e217c4ac25 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:48.540877 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-ee0017ed-bfc5-445b-8a31-c4e217c4ac25 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1732 microversion: 2.1 time: 0.237621 Aug 24 07:59:48.551178 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 253/499] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:48 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1732 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:48.831867 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-0da8e51d-9847-4d75-b4d5-26bea8219e2a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:48.832591 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-0da8e51d-9847-4d75-b4d5-26bea8219e2a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:48.839360 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0da8e51d-9847-4d75-b4d5-26bea8219e2a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:48.840348 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0da8e51d-9847-4d75-b4d5-26bea8219e2a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:48.841073 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0da8e51d-9847-4d75-b4d5-26bea8219e2a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:48.842445 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0da8e51d-9847-4d75-b4d5-26bea8219e2a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:48.843192 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0da8e51d-9847-4d75-b4d5-26bea8219e2a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:48.843868 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0da8e51d-9847-4d75-b4d5-26bea8219e2a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:48.998449 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-0da8e51d-9847-4d75-b4d5-26bea8219e2a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:49.006481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-0da8e51d-9847-4d75-b4d5-26bea8219e2a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1260 microversion: 2.1 time: 0.179232 Aug 24 07:59:49.007639 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 247/500] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:48 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:49.567123 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-94496d55-5359-4057-ad42-f43865a1708a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:49.567735 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-94496d55-5359-4057-ad42-f43865a1708a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:49.575003 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-94496d55-5359-4057-ad42-f43865a1708a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:49.575486 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-94496d55-5359-4057-ad42-f43865a1708a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:49.575918 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-94496d55-5359-4057-ad42-f43865a1708a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:49.576876 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-94496d55-5359-4057-ad42-f43865a1708a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:49.577324 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-94496d55-5359-4057-ad42-f43865a1708a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:49.577741 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-94496d55-5359-4057-ad42-f43865a1708a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:49.787168 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-94496d55-5359-4057-ad42-f43865a1708a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:49.860792 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-94496d55-5359-4057-ad42-f43865a1708a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1732 microversion: 2.1 time: 0.236233 Aug 24 07:59:49.860792 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 254/501] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:49 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1732 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:50.052952 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b17b727a-e40d-493d-9214-335c27d01b4c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:50.053631 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-b17b727a-e40d-493d-9214-335c27d01b4c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:50.076935 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b17b727a-e40d-493d-9214-335c27d01b4c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:50.078021 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b17b727a-e40d-493d-9214-335c27d01b4c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:50.079632 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b17b727a-e40d-493d-9214-335c27d01b4c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:50.080381 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b17b727a-e40d-493d-9214-335c27d01b4c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:50.083150 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b17b727a-e40d-493d-9214-335c27d01b4c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:50.083832 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b17b727a-e40d-493d-9214-335c27d01b4c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:50.272214 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b17b727a-e40d-493d-9214-335c27d01b4c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:50.282818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-b17b727a-e40d-493d-9214-335c27d01b4c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1260 microversion: 2.1 time: 0.242636 Aug 24 07:59:50.301625 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 248/502] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:50 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1260 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:50.843013 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-a43eaf27-3452-4016-831f-42a5a2e6ed24 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:50.843771 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-a43eaf27-3452-4016-831f-42a5a2e6ed24 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:50.850381 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a43eaf27-3452-4016-831f-42a5a2e6ed24 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:50.851094 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a43eaf27-3452-4016-831f-42a5a2e6ed24 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:50.851709 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a43eaf27-3452-4016-831f-42a5a2e6ed24 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:50.852404 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a43eaf27-3452-4016-831f-42a5a2e6ed24 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:50.853046 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a43eaf27-3452-4016-831f-42a5a2e6ed24 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:50.853471 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a43eaf27-3452-4016-831f-42a5a2e6ed24 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:50.913817 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-6df7a7a0-9654-4598-8f27-b6f17d275c55 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:50.914230 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-6df7a7a0-9654-4598-8f27-b6f17d275c55 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:50.922190 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6df7a7a0-9654-4598-8f27-b6f17d275c55 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:50.922939 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6df7a7a0-9654-4598-8f27-b6f17d275c55 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:50.923547 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6df7a7a0-9654-4598-8f27-b6f17d275c55 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:50.925117 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6df7a7a0-9654-4598-8f27-b6f17d275c55 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:50.925742 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6df7a7a0-9654-4598-8f27-b6f17d275c55 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:50.926349 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6df7a7a0-9654-4598-8f27-b6f17d275c55 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:50.973047 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-6df7a7a0-9654-4598-8f27-b6f17d275c55 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711/os-volume_attachments/431ca80f-1150-4d08-aa85-f6666279d59f" status: 200 len: 194 microversion: 2.20 time: 0.064008 Aug 24 07:59:50.980166 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 249/503] 10.222.0.72 () {60 vars in 1454 bytes} [Wed Aug 24 07:59:50 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711/os-volume_attachments/431ca80f-1150-4d08-aa85-f6666279d59f => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:59:51.014672 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-a43eaf27-3452-4016-831f-42a5a2e6ed24 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:51.026681 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-a43eaf27-3452-4016-831f-42a5a2e6ed24 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1732 microversion: 2.1 time: 0.187363 Aug 24 07:59:51.037189 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 255/504] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:50 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1732 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:51.055840 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-ccbdd960-41fc-4e8a-9f23-9751ea2aff44 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:51.056397 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-ccbdd960-41fc-4e8a-9f23-9751ea2aff44 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:51.063236 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ccbdd960-41fc-4e8a-9f23-9751ea2aff44 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:51.063982 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ccbdd960-41fc-4e8a-9f23-9751ea2aff44 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:51.064435 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ccbdd960-41fc-4e8a-9f23-9751ea2aff44 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:51.065249 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ccbdd960-41fc-4e8a-9f23-9751ea2aff44 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:51.065873 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ccbdd960-41fc-4e8a-9f23-9751ea2aff44 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:51.066304 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ccbdd960-41fc-4e8a-9f23-9751ea2aff44 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:51.209432 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-469695f2-c2a8-40c6-a158-6bf3be5687d0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3dd723d2-8a78-4ce5-a31a-dbf685249f82", "device": "/dev/sdb"}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:59:51.212367 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-469695f2-c2a8-40c6-a158-6bf3be5687d0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:51.229195 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-469695f2-c2a8-40c6-a158-6bf3be5687d0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:51.229690 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-469695f2-c2a8-40c6-a158-6bf3be5687d0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:51.230124 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-469695f2-c2a8-40c6-a158-6bf3be5687d0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:51.232689 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-469695f2-c2a8-40c6-a158-6bf3be5687d0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:51.233329 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-469695f2-c2a8-40c6-a158-6bf3be5687d0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:51.234452 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-469695f2-c2a8-40c6-a158-6bf3be5687d0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:51.317030 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.objects.instance [None req-ccbdd960-41fc-4e8a-9f23-9751ea2aff44 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lazy-loading 'services' on Instance uuid a266e179-03cc-40b3-902d-aab680174711 {{(pid=127589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:59:51.673958 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-ccbdd960-41fc-4e8a-9f23-9751ea2aff44 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711/os-volume_attachments/431ca80f-1150-4d08-aa85-f6666279d59f" status: 202 len: 0 microversion: 2.20 time: 0.622194 Aug 24 07:59:51.678358 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 250/505] 10.222.0.72 () {60 vars in 1457 bytes} [Wed Aug 24 07:59:51 2022] DELETE /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711/os-volume_attachments/431ca80f-1150-4d08-aa85-f6666279d59f => generated 0 bytes in 624 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:59:51.684986 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-44185b49-268a-4a83-bd65-9e663b76b219 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:51.685924 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-44185b49-268a-4a83-bd65-9e663b76b219 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:51.695352 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-44185b49-268a-4a83-bd65-9e663b76b219 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:51.695352 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-44185b49-268a-4a83-bd65-9e663b76b219 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:51.695352 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-44185b49-268a-4a83-bd65-9e663b76b219 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:51.695352 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-44185b49-268a-4a83-bd65-9e663b76b219 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:51.695775 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-44185b49-268a-4a83-bd65-9e663b76b219 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:51.696222 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-44185b49-268a-4a83-bd65-9e663b76b219 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:51.941620 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-44185b49-268a-4a83-bd65-9e663b76b219 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:51.954953 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-44185b49-268a-4a83-bd65-9e663b76b219 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1444 microversion: 2.1 time: 0.275054 Aug 24 07:59:51.955729 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 251/506] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:51 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1444 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:51.966683 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-2c0c9167-0bf0-450d-8196-a2d655223d94 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:51.968898 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-2c0c9167-0bf0-450d-8196-a2d655223d94 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:51.977182 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2c0c9167-0bf0-450d-8196-a2d655223d94 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:51.977703 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2c0c9167-0bf0-450d-8196-a2d655223d94 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:51.978193 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2c0c9167-0bf0-450d-8196-a2d655223d94 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:51.981965 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2c0c9167-0bf0-450d-8196-a2d655223d94 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:51.982655 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2c0c9167-0bf0-450d-8196-a2d655223d94 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:51.983393 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2c0c9167-0bf0-450d-8196-a2d655223d94 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:52.024779 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:52.047149 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-2c0c9167-0bf0-450d-8196-a2d655223d94 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090572 Aug 24 07:59:52.052168 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 252/507] 10.222.0.72 () {60 vars in 1343 bytes} [Wed Aug 24 07:59:51 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:59:52.053886 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-d3fc99af-730f-43bf-9c0b-79cc73e1545f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:52.054491 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-d3fc99af-730f-43bf-9c0b-79cc73e1545f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:52.060863 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d3fc99af-730f-43bf-9c0b-79cc73e1545f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:52.061469 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d3fc99af-730f-43bf-9c0b-79cc73e1545f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:52.061829 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d3fc99af-730f-43bf-9c0b-79cc73e1545f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:52.062523 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d3fc99af-730f-43bf-9c0b-79cc73e1545f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:52.062971 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d3fc99af-730f-43bf-9c0b-79cc73e1545f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:52.063391 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d3fc99af-730f-43bf-9c0b-79cc73e1545f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:52.240397 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-d3fc99af-730f-43bf-9c0b-79cc73e1545f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:52.249701 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-d3fc99af-730f-43bf-9c0b-79cc73e1545f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1444 microversion: 2.1 time: 0.200748 Aug 24 07:59:52.250384 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 253/508] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:52 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1444 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:52.255017 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-6669c219-1851-4942-9176-40ddba80837c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:52.255655 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-6669c219-1851-4942-9176-40ddba80837c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:52.262491 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6669c219-1851-4942-9176-40ddba80837c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:52.262977 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6669c219-1851-4942-9176-40ddba80837c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:52.263951 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6669c219-1851-4942-9176-40ddba80837c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:52.264979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6669c219-1851-4942-9176-40ddba80837c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:52.265409 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6669c219-1851-4942-9176-40ddba80837c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:52.265838 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6669c219-1851-4942-9176-40ddba80837c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:52.495405 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-6669c219-1851-4942-9176-40ddba80837c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:52.505862 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-6669c219-1851-4942-9176-40ddba80837c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1712 microversion: 2.1 time: 0.254486 Aug 24 07:59:52.506928 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 254/509] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:52 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1712 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:52.658161 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b7f333a1-5b24-4ea9-bf2c-b3fdf7e22e78 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:52.658658 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-b7f333a1-5b24-4ea9-bf2c-b3fdf7e22e78 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:52.664906 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b7f333a1-5b24-4ea9-bf2c-b3fdf7e22e78 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:52.665386 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b7f333a1-5b24-4ea9-bf2c-b3fdf7e22e78 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:52.666204 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b7f333a1-5b24-4ea9-bf2c-b3fdf7e22e78 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:52.666628 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b7f333a1-5b24-4ea9-bf2c-b3fdf7e22e78 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:52.667076 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b7f333a1-5b24-4ea9-bf2c-b3fdf7e22e78 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:52.667560 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b7f333a1-5b24-4ea9-bf2c-b3fdf7e22e78 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:52.767111 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-b7f333a1-5b24-4ea9-bf2c-b3fdf7e22e78 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] HTTP exception thrown: Cannot 'detach_volume' instance f31397ec-5acf-4a90-a500-280a47ed1f55 while it is in vm_state rescued Aug 24 07:59:52.768877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b7f333a1-5b24-4ea9-bf2c-b3fdf7e22e78 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Request method failure captured: Aug 24 07:59:52.768877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: DELETE /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55/os-volume_attachments/4b2a9569-edc5-4595-bfb1-85cf0714c6df HTTP/1.1 Aug 24 07:59:52.768877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 07:59:52.768877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 07:59:52.768877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 07:59:52.768877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 07:59:52.768877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 07:59:52.768877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 07:59:52.768877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 07:59:52.768877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 07:59:52.768877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdl77mMuddCdCHjWrd8DH39AXHJIXv_-vLiyIketMjF1z0b7hh5tClcXlKlUUpe1LXwWnzheC-DGqeDS2yPf8oVj7oRphdHRib4NxjdH4iuB81Vj3VJAsKDThkhA68xfK2yl5RQVIZgDuEu0yeMW2l7InWT4D9Yx0eT-Xgtq0jRxlN8 Aug 24 07:59:52.768877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 07:59:52.768877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 07:59:52.768877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 07:59:52.768877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 07:59:52.768877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 07:59:52.768877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 07:59:52.768877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: e52495240cf04548a21b411c32bbe1e1 Aug 24 07:59:52.768877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1800569160 Aug 24 07:59:52.768877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 07:59:52.768877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 07:59:52.770510 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_e52495240cf04548a21b411c32bbe1e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/e52495240cf04548a21b411c32bbe1e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/e52495240cf04548a21b411c32bbe1e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/e52495240cf04548a21b411c32bbe1e1"}]}] Aug 24 07:59:52.770510 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1800569160 Aug 24 07:59:52.770510 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: e52495240cf04548a21b411c32bbe1e1 Aug 24 07:59:52.770510 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1800569160 Aug 24 07:59:52.770510 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-ServerRescueNegativeTestJSON-1800569160-project Aug 24 07:59:52.770510 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 07:59:52.770510 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 07:59:52.770510 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 51729e82a3784d04aef89ed83f1576bd Aug 24 07:59:52.770510 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1800569160-project Aug 24 07:59:52.770510 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 07:59:52.770510 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Cannot 'detach_volume' instance f31397ec-5acf-4a90-a500-280a47ed1f55 while it is in vm_state rescued Aug 24 07:59:52.771174 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'server_id': 'f31397ec-5acf-4a90-a500-280a47ed1f55', 'id': '4b2a9569-edc5-4595-bfb1-85cf0714c6df'} Aug 24 07:59:52.771174 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:59:52.771174 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:59:52.771174 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 07:59:52.771174 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 07:59:52.771174 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 07:59:52.771174 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 07:59:52.771174 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 07:59:52.771174 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 07:59:52.771174 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f31397ec-5acf-4a90-a500-280a47ed1f55 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 07:59:52.771174 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:59:52.771174 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:59:52.771174 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:59:52.771174 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:59:52.771174 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:59:52.771174 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:59:52.771174 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:59:52.771174 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:59:52.771174 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:59:52.771174 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:59:52.772404 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 07:59:52.772404 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 07:59:52.772404 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 07:59:52.772404 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 07:59:52.772404 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f31397ec-5acf-4a90-a500-280a47ed1f55 while it is in vm_state rescued Aug 24 07:59:52.772404 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:59:52.772404 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:59:52.772404 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:59:52.772404 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:59:52.772404 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:59:52.772404 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:59:52.772404 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:59:52.772404 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:59:52.772404 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f31397ec-5acf-4a90-a500-280a47ed1f55 while it is in vm_state rescued Aug 24 07:59:52.772404 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 07:59:52.772404 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b7f333a1-5b24-4ea9-bf2c-b3fdf7e22e78 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Returning 409 to user: Cannot 'detach_volume' instance f31397ec-5acf-4a90-a500-280a47ed1f55 while it is in vm_state rescued {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:59:52.773443 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-b7f333a1-5b24-4ea9-bf2c-b3fdf7e22e78 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55/os-volume_attachments/4b2a9569-edc5-4595-bfb1-85cf0714c6df" status: 409 len: 152 microversion: 2.1 time: 0.116530 Aug 24 07:59:52.774691 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 255/510] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 24 07:59:52 2022] DELETE /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55/os-volume_attachments/4b2a9569-edc5-4595-bfb1-85cf0714c6df => generated 152 bytes in 121 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 07:59:52.783948 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-0afeaa1a-d885-41d0-89ac-b3b0236a078c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:59:52.784487 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-0afeaa1a-d885-41d0-89ac-b3b0236a078c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:52.793024 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0afeaa1a-d885-41d0-89ac-b3b0236a078c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:52.793345 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0afeaa1a-d885-41d0-89ac-b3b0236a078c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:52.794476 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0afeaa1a-d885-41d0-89ac-b3b0236a078c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:52.794476 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0afeaa1a-d885-41d0-89ac-b3b0236a078c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:52.794948 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0afeaa1a-d885-41d0-89ac-b3b0236a078c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:52.795552 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0afeaa1a-d885-41d0-89ac-b3b0236a078c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:53.217903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-469695f2-c2a8-40c6-a158-6bf3be5687d0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "POST /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.018459 Aug 24 07:59:53.227689 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 256/511] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 24 07:59:51 2022] POST /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e/os-volume_attachments => generated 194 bytes in 2020 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:59:53.227689 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-729b4777-9c21-4012-b85f-581cfe174a57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:53.228447 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-729b4777-9c21-4012-b85f-581cfe174a57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:53.234147 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:53.237458 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-729b4777-9c21-4012-b85f-581cfe174a57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:53.238535 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-729b4777-9c21-4012-b85f-581cfe174a57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:53.239152 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-729b4777-9c21-4012-b85f-581cfe174a57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:53.239873 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-729b4777-9c21-4012-b85f-581cfe174a57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:53.240329 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-729b4777-9c21-4012-b85f-581cfe174a57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:53.240782 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-729b4777-9c21-4012-b85f-581cfe174a57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:53.295079 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-729b4777-9c21-4012-b85f-581cfe174a57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075298 Aug 24 07:59:53.295829 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 257/512] 10.222.0.72 () {60 vars in 1343 bytes} [Wed Aug 24 07:59:53 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:59:53.484325 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-0afeaa1a-d885-41d0-89ac-b3b0236a078c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "POST /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55/action" status: 202 len: 0 microversion: 2.1 time: 0.705056 Aug 24 07:59:53.486981 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 256/513] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 24 07:59:52 2022] POST /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55/action => generated 0 bytes in 710 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 07:59:53.507464 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-eed29cfe-5801-49dd-a840-5c6385d993dc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:53.508245 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-eed29cfe-5801-49dd-a840-5c6385d993dc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:53.524082 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-eed29cfe-5801-49dd-a840-5c6385d993dc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:53.524082 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-eed29cfe-5801-49dd-a840-5c6385d993dc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:53.524082 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-eed29cfe-5801-49dd-a840-5c6385d993dc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:53.525064 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-eed29cfe-5801-49dd-a840-5c6385d993dc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:53.525291 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-eed29cfe-5801-49dd-a840-5c6385d993dc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:53.525812 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-eed29cfe-5801-49dd-a840-5c6385d993dc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:53.732042 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-eed29cfe-5801-49dd-a840-5c6385d993dc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:53.741008 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-eed29cfe-5801-49dd-a840-5c6385d993dc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1720 microversion: 2.1 time: 0.247302 Aug 24 07:59:53.749100 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 258/514] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:53 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1720 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:54.309188 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-8c6372d3-35ed-43b2-9892-c663a82b4f4b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:54.314342 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-8c6372d3-35ed-43b2-9892-c663a82b4f4b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:54.323197 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8c6372d3-35ed-43b2-9892-c663a82b4f4b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:54.323838 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8c6372d3-35ed-43b2-9892-c663a82b4f4b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:54.324581 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8c6372d3-35ed-43b2-9892-c663a82b4f4b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:54.325325 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8c6372d3-35ed-43b2-9892-c663a82b4f4b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:54.325773 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8c6372d3-35ed-43b2-9892-c663a82b4f4b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:54.326199 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8c6372d3-35ed-43b2-9892-c663a82b4f4b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:54.398164 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-8c6372d3-35ed-43b2-9892-c663a82b4f4b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.094345 Aug 24 07:59:54.399850 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 257/515] 10.222.0.72 () {60 vars in 1343 bytes} [Wed Aug 24 07:59:54 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:54.466963 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-25b7ffc6-ef4b-4082-a61e-c65e6a583d2e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:54.467597 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-25b7ffc6-ef4b-4082-a61e-c65e6a583d2e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:54.474324 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-25b7ffc6-ef4b-4082-a61e-c65e6a583d2e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:54.475055 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-25b7ffc6-ef4b-4082-a61e-c65e6a583d2e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:54.475566 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-25b7ffc6-ef4b-4082-a61e-c65e6a583d2e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:54.476376 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-25b7ffc6-ef4b-4082-a61e-c65e6a583d2e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:54.477069 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-25b7ffc6-ef4b-4082-a61e-c65e6a583d2e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:54.477568 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-25b7ffc6-ef4b-4082-a61e-c65e6a583d2e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:54.505501 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-25b7ffc6-ef4b-4082-a61e-c65e6a583d2e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Going to try to terminate instance {{(pid=127590) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:59:54.766193 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-5482c946-6e5a-4d59-b17c-b416acc362a3 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:54.767540 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-5482c946-6e5a-4d59-b17c-b416acc362a3 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:54.784314 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5482c946-6e5a-4d59-b17c-b416acc362a3 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:54.785503 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5482c946-6e5a-4d59-b17c-b416acc362a3 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:54.787538 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5482c946-6e5a-4d59-b17c-b416acc362a3 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:54.791783 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5482c946-6e5a-4d59-b17c-b416acc362a3 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:54.792580 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5482c946-6e5a-4d59-b17c-b416acc362a3 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:54.794951 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5482c946-6e5a-4d59-b17c-b416acc362a3 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:54.881250 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-25b7ffc6-ef4b-4082-a61e-c65e6a583d2e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 204 len: 0 microversion: 2.20 time: 0.418819 Aug 24 07:59:54.885873 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 259/516] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 24 07:59:54 2022] DELETE /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 07:59:54.892932 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-9c55d306-88d2-4fd8-bde8-1ac466ae785b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:54.893955 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-9c55d306-88d2-4fd8-bde8-1ac466ae785b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:54.901388 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9c55d306-88d2-4fd8-bde8-1ac466ae785b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:54.902234 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9c55d306-88d2-4fd8-bde8-1ac466ae785b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:54.905203 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9c55d306-88d2-4fd8-bde8-1ac466ae785b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:54.906366 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9c55d306-88d2-4fd8-bde8-1ac466ae785b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:54.907173 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9c55d306-88d2-4fd8-bde8-1ac466ae785b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:54.908076 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9c55d306-88d2-4fd8-bde8-1ac466ae785b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:55.032384 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-5482c946-6e5a-4d59-b17c-b416acc362a3 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:55.041602 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-5482c946-6e5a-4d59-b17c-b416acc362a3 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1720 microversion: 2.1 time: 0.279279 Aug 24 07:59:55.057735 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 258/517] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:54 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1720 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:59:55.081201 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9c55d306-88d2-4fd8-bde8-1ac466ae785b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:55.093242 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9c55d306-88d2-4fd8-bde8-1ac466ae785b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:55.094981 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9c55d306-88d2-4fd8-bde8-1ac466ae785b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:55.096146 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-9c55d306-88d2-4fd8-bde8-1ac466ae785b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1723 microversion: 2.20 time: 0.208289 Aug 24 07:59:55.109416 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 260/518] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:59:54 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:59:55.315478 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-574b8b02-0926-427e-ac79-148f795fbc90 req-e1ae752f-7cd1-4ea5-a3c0-236b66e131ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ce799f4-91d9-4521-af5d-63757a11823c", "tag": "b6e8c168-af88-483f-9e17-53d9c3c9d376"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:59:55.332212 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-574b8b02-0926-427e-ac79-148f795fbc90 req-e1ae752f-7cd1-4ea5-a3c0-236b66e131ed service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:55.332711 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-574b8b02-0926-427e-ac79-148f795fbc90 req-e1ae752f-7cd1-4ea5-a3c0-236b66e131ed service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:55.333366 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-574b8b02-0926-427e-ac79-148f795fbc90 req-e1ae752f-7cd1-4ea5-a3c0-236b66e131ed service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:55.346251 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-574b8b02-0926-427e-ac79-148f795fbc90 req-e1ae752f-7cd1-4ea5-a3c0-236b66e131ed service nova] Creating event network-changed:b6e8c168-af88-483f-9e17-53d9c3c9d376 for instance 3ce799f4-91d9-4521-af5d-63757a11823c on hv-cinder-85427 Aug 24 07:59:55.354352 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-574b8b02-0926-427e-ac79-148f795fbc90 req-e1ae752f-7cd1-4ea5-a3c0-236b66e131ed service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044582 Aug 24 07:59:55.356064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 259/519] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:59:56.065934 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-566fab8c-a5a8-464a-9bce-3e3b6b3c5a45 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:56.069978 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-566fab8c-a5a8-464a-9bce-3e3b6b3c5a45 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:56.077856 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-566fab8c-a5a8-464a-9bce-3e3b6b3c5a45 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:56.078564 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-566fab8c-a5a8-464a-9bce-3e3b6b3c5a45 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:56.082629 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-566fab8c-a5a8-464a-9bce-3e3b6b3c5a45 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:56.083843 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-566fab8c-a5a8-464a-9bce-3e3b6b3c5a45 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:56.084491 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-566fab8c-a5a8-464a-9bce-3e3b6b3c5a45 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:56.085448 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-566fab8c-a5a8-464a-9bce-3e3b6b3c5a45 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:56.125151 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-7936172f-0e2e-4956-a08b-df74c84bbca9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:56.126483 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-7936172f-0e2e-4956-a08b-df74c84bbca9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:56.133588 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7936172f-0e2e-4956-a08b-df74c84bbca9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:56.134814 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7936172f-0e2e-4956-a08b-df74c84bbca9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:56.135253 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7936172f-0e2e-4956-a08b-df74c84bbca9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:56.136125 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7936172f-0e2e-4956-a08b-df74c84bbca9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:56.136675 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7936172f-0e2e-4956-a08b-df74c84bbca9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:56.137999 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7936172f-0e2e-4956-a08b-df74c84bbca9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:56.305111 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-566fab8c-a5a8-464a-9bce-3e3b6b3c5a45 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:56.327076 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-566fab8c-a5a8-464a-9bce-3e3b6b3c5a45 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1720 microversion: 2.1 time: 0.261883 Aug 24 07:59:56.337006 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 261/520] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:56 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1720 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:56.344733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7936172f-0e2e-4956-a08b-df74c84bbca9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:56.354562 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7936172f-0e2e-4956-a08b-df74c84bbca9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:56.356598 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7936172f-0e2e-4956-a08b-df74c84bbca9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:56.358052 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-7936172f-0e2e-4956-a08b-df74c84bbca9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1723 microversion: 2.20 time: 0.238891 Aug 24 07:59:56.376462 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 260/521] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:59:56 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:59:57.353205 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-f5d93c68-788a-4035-b436-8ffb0757a8be tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:57.353786 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-f5d93c68-788a-4035-b436-8ffb0757a8be tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:57.360339 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f5d93c68-788a-4035-b436-8ffb0757a8be tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:57.360862 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f5d93c68-788a-4035-b436-8ffb0757a8be tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:57.361305 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f5d93c68-788a-4035-b436-8ffb0757a8be tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:57.361996 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f5d93c68-788a-4035-b436-8ffb0757a8be tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:57.362500 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f5d93c68-788a-4035-b436-8ffb0757a8be tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:57.362875 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f5d93c68-788a-4035-b436-8ffb0757a8be tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:57.365651 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:57.394744 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-0cca29a6-f9d2-4fe7-a3b9-76dea450b5cd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:57.394744 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-0cca29a6-f9d2-4fe7-a3b9-76dea450b5cd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:57.396337 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0cca29a6-f9d2-4fe7-a3b9-76dea450b5cd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:57.396983 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0cca29a6-f9d2-4fe7-a3b9-76dea450b5cd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:57.397749 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0cca29a6-f9d2-4fe7-a3b9-76dea450b5cd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:57.398678 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0cca29a6-f9d2-4fe7-a3b9-76dea450b5cd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:57.409250 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0cca29a6-f9d2-4fe7-a3b9-76dea450b5cd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:57.410270 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0cca29a6-f9d2-4fe7-a3b9-76dea450b5cd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:57.553915 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-f5d93c68-788a-4035-b436-8ffb0757a8be tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:57.565530 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-f5d93c68-788a-4035-b436-8ffb0757a8be tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1720 microversion: 2.1 time: 0.216085 Aug 24 07:59:57.566698 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 262/522] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:57 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1720 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:57.582969 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-0cca29a6-f9d2-4fe7-a3b9-76dea450b5cd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:57.593566 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-0cca29a6-f9d2-4fe7-a3b9-76dea450b5cd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:57.595387 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-0cca29a6-f9d2-4fe7-a3b9-76dea450b5cd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:57.596758 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-0cca29a6-f9d2-4fe7-a3b9-76dea450b5cd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1723 microversion: 2.20 time: 0.212801 Aug 24 07:59:57.597774 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 261/523] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:59:57 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:59:58.252429 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-f28d1c6f-975b-4d8b-92c9-622bd4516df4 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Action: 'create', calling method: .version_select at 0x7f320c2f1940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2059212825", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHv8g7fQ+bdfPl09b8HPUdDZFCjaRZIJWQIXh65ThDY+RpDnZ+/faf/jAr33Qg31Yf/JixukBH55iPt3Znvw16ZHxIr3CtroDy1OAu0ozzqnGH5ScL6nvsO9i8DWJQLXVA=="}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:59:58.268352 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-f28d1c6f-975b-4d8b-92c9-622bd4516df4 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Getting quotas for project 4b41efe770974b3aa9a34e21dc2ea5d2. Resources: {'key_pairs'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:59:58.272778 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-f28d1c6f-975b-4d8b-92c9-622bd4516df4 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Getting quotas for user b3fa420e4c0049b9ae5cee7717422cda and project 4b41efe770974b3aa9a34e21dc2ea5d2. Resources: {'key_pairs'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:59:58.389203 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-f28d1c6f-975b-4d8b-92c9-622bd4516df4 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.141043 Aug 24 07:59:58.389886 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 263/524] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 24 07:59:58 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:59:58.444197 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-bb1e1377-5974-4cd4-8736-09015b9ae45c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1876433104", "imageRef": "eeeae27b-39a4-40dc-b021-5d8fd683e19c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2059212825", "networks": [{"uuid": "7a10c488-dc2f-4637-9b64-65c3d3616e74"}]}} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:59:58.510799 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.network.neutron [None req-bb1e1377-5974-4cd4-8736-09015b9ae45c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] validate_networks() for [('7a10c488-dc2f-4637-9b64-65c3d3616e74', None, None, None, None, None)] {{(pid=127589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:59:58.588636 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-e87aa010-cd46-405b-8839-6be957f64f5c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:58.590397 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-e87aa010-cd46-405b-8839-6be957f64f5c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:58.596608 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e87aa010-cd46-405b-8839-6be957f64f5c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:58.597270 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e87aa010-cd46-405b-8839-6be957f64f5c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:58.597950 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e87aa010-cd46-405b-8839-6be957f64f5c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:58.598720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e87aa010-cd46-405b-8839-6be957f64f5c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:58.599238 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e87aa010-cd46-405b-8839-6be957f64f5c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:58.599749 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e87aa010-cd46-405b-8839-6be957f64f5c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:58.743394 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-e87aa010-cd46-405b-8839-6be957f64f5c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:58.752783 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-e87aa010-cd46-405b-8839-6be957f64f5c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1726 microversion: 2.1 time: 0.168396 Aug 24 07:59:58.753353 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 264/525] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:58 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:59:58.758027 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-0c0741c5-0de3-49cc-961b-939d059af863 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:58.758636 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-0c0741c5-0de3-49cc-961b-939d059af863 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:58.765245 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0c0741c5-0de3-49cc-961b-939d059af863 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:58.765734 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0c0741c5-0de3-49cc-961b-939d059af863 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:58.766166 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0c0741c5-0de3-49cc-961b-939d059af863 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:58.766861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0c0741c5-0de3-49cc-961b-939d059af863 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:58.767307 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0c0741c5-0de3-49cc-961b-939d059af863 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:58.767723 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0c0741c5-0de3-49cc-961b-939d059af863 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:58.905297 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-0c0741c5-0de3-49cc-961b-939d059af863 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:58.914224 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-0c0741c5-0de3-49cc-961b-939d059af863 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:58.915860 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-0c0741c5-0de3-49cc-961b-939d059af863 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:58.917156 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-0c0741c5-0de3-49cc-961b-939d059af863 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1723 microversion: 2.20 time: 0.162688 Aug 24 07:59:58.917776 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 265/526] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:59:58 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:59:58.923282 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-5b5120da-a4e6-49fa-9635-490b22772c64 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:58.923829 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-5b5120da-a4e6-49fa-9635-490b22772c64 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:58.929671 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5b5120da-a4e6-49fa-9635-490b22772c64 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:58.930392 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5b5120da-a4e6-49fa-9635-490b22772c64 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:58.930900 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5b5120da-a4e6-49fa-9635-490b22772c64 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:58.931692 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5b5120da-a4e6-49fa-9635-490b22772c64 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:58.932208 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5b5120da-a4e6-49fa-9635-490b22772c64 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:58.932894 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5b5120da-a4e6-49fa-9635-490b22772c64 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:59.013187 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-5b5120da-a4e6-49fa-9635-490b22772c64 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093229 Aug 24 07:59:59.013819 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 266/527] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 24 07:59:58 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:59:59.125334 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-bb1e1377-5974-4cd4-8736-09015b9ae45c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Flavor limits 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:59:59.125765 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-bb1e1377-5974-4cd4-8736-09015b9ae45c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Image limits 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:59:59.126250 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-bb1e1377-5974-4cd4-8736-09015b9ae45c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Flavor pref 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:59:59.126714 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-bb1e1377-5974-4cd4-8736-09015b9ae45c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Image pref 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:59:59.127180 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-bb1e1377-5974-4cd4-8736-09015b9ae45c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:59:59.136129 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bb1e1377-5974-4cd4-8736-09015b9ae45c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:59.136693 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bb1e1377-5974-4cd4-8736-09015b9ae45c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:59.137174 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bb1e1377-5974-4cd4-8736-09015b9ae45c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:59.137923 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bb1e1377-5974-4cd4-8736-09015b9ae45c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:59.138387 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bb1e1377-5974-4cd4-8736-09015b9ae45c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:59.138810 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bb1e1377-5974-4cd4-8736-09015b9ae45c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:59.157002 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.quota [None req-bb1e1377-5974-4cd4-8736-09015b9ae45c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Getting quotas for project 4b41efe770974b3aa9a34e21dc2ea5d2. Resources: {'cores', 'instances', 'ram'} {{(pid=127589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:59:59.166645 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.quota [None req-bb1e1377-5974-4cd4-8736-09015b9ae45c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Getting quotas for user b3fa420e4c0049b9ae5cee7717422cda and project 4b41efe770974b3aa9a34e21dc2ea5d2. Resources: {'cores', 'instances', 'ram'} {{(pid=127589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:59:59.179045 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-bb1e1377-5974-4cd4-8736-09015b9ae45c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Going to run 1 instances... {{(pid=127589) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:59:59.181556 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-bb1e1377-5974-4cd4-8736-09015b9ae45c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='eeeae27b-39a4-40dc-b021-5d8fd683e19c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:59:59.344363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-bb1e1377-5974-4cd4-8736-09015b9ae45c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.904117 Aug 24 07:59:59.351272 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 262/528] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 24 07:59:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:59:59.356491 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-2cfdd6c1-a614-4480-8e17-5aa9c8c078ce tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:59.357138 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-2cfdd6c1-a614-4480-8e17-5aa9c8c078ce tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:59.458197 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-030242e2-672c-43d8-9e1e-b1c736e49812 req-964ecf14-6034-4a3c-9bb8-f56ba06293e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a266e179-03cc-40b3-902d-aab680174711", "name": "network-vif-deleted", "tag": "45373581-1bd1-4a1b-aff0-a6e9993cd6b9"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:59:59.476818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-030242e2-672c-43d8-9e1e-b1c736e49812 req-964ecf14-6034-4a3c-9bb8-f56ba06293e5 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:59.477224 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-030242e2-672c-43d8-9e1e-b1c736e49812 req-964ecf14-6034-4a3c-9bb8-f56ba06293e5 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:59.477662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-030242e2-672c-43d8-9e1e-b1c736e49812 req-964ecf14-6034-4a3c-9bb8-f56ba06293e5 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:59.482008 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-2cfdd6c1-a614-4480-8e17-5aa9c8c078ce tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:59:59.499537 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-2cfdd6c1-a614-4480-8e17-5aa9c8c078ce tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1259 microversion: 2.1 time: 0.143438 Aug 24 07:59:59.500200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 267/529] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 07:59:59 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:59:59.522897 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-030242e2-672c-43d8-9e1e-b1c736e49812 req-964ecf14-6034-4a3c-9bb8-f56ba06293e5 service nova] Creating event network-vif-deleted:45373581-1bd1-4a1b-aff0-a6e9993cd6b9 for instance a266e179-03cc-40b3-902d-aab680174711 on hv-cinder-85427 Aug 24 07:59:59.530048 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-030242e2-672c-43d8-9e1e-b1c736e49812 req-964ecf14-6034-4a3c-9bb8-f56ba06293e5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076009 Aug 24 07:59:59.535270 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 263/530] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 07:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:59:59.943018 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-866c6711-259b-45ac-843b-3b23dd9f477e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:59:59.943954 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-866c6711-259b-45ac-843b-3b23dd9f477e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:59:59.952919 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-866c6711-259b-45ac-843b-3b23dd9f477e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:59.953713 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-866c6711-259b-45ac-843b-3b23dd9f477e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:59.954295 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-866c6711-259b-45ac-843b-3b23dd9f477e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:59.955232 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-866c6711-259b-45ac-843b-3b23dd9f477e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:59.956034 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-866c6711-259b-45ac-843b-3b23dd9f477e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:59.956636 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-866c6711-259b-45ac-843b-3b23dd9f477e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:59.993539 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-866c6711-259b-45ac-843b-3b23dd9f477e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:59:59.994266 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-866c6711-259b-45ac-843b-3b23dd9f477e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:59:59.994847 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-866c6711-259b-45ac-843b-3b23dd9f477e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:59:59.995494 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.objects.instance [None req-866c6711-259b-45ac-843b-3b23dd9f477e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lazy-loading 'fault' on Instance uuid a266e179-03cc-40b3-902d-aab680174711 {{(pid=127590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:00:00.081292 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-866c6711-259b-45ac-843b-3b23dd9f477e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:00.090743 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-866c6711-259b-45ac-843b-3b23dd9f477e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:00.092260 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-866c6711-259b-45ac-843b-3b23dd9f477e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:00.094240 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-866c6711-259b-45ac-843b-3b23dd9f477e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 200 len: 1371 microversion: 2.20 time: 0.154958 Aug 24 08:00:00.094820 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 268/531] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 07:59:59 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:00.523913 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e5e4d83c-4bce-4cd2-9e43-2903e19e20b2 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:00.524731 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-e5e4d83c-4bce-4cd2-9e43-2903e19e20b2 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:00.598702 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e5e4d83c-4bce-4cd2-9e43-2903e19e20b2 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:00.607174 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-e5e4d83c-4bce-4cd2-9e43-2903e19e20b2 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1259 microversion: 2.1 time: 0.087818 Aug 24 08:00:00.607962 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 264/532] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:00 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1259 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:00.677156 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-922a1a8f-3853-41d3-9872-6911685626db req-54534a71-59ac-43e4-acbb-ce2826247cfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f31397ec-5acf-4a90-a500-280a47ed1f55", "tag": "8acdda10-43f7-423f-9513-4deb10644221"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:00:00.700048 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-922a1a8f-3853-41d3-9872-6911685626db req-54534a71-59ac-43e4-acbb-ce2826247cfd service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:00.702870 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-922a1a8f-3853-41d3-9872-6911685626db req-54534a71-59ac-43e4-acbb-ce2826247cfd service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:00.704291 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-922a1a8f-3853-41d3-9872-6911685626db req-54534a71-59ac-43e4-acbb-ce2826247cfd service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:00.728025 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-922a1a8f-3853-41d3-9872-6911685626db req-54534a71-59ac-43e4-acbb-ce2826247cfd service nova] Creating event network-changed:8acdda10-43f7-423f-9513-4deb10644221 for instance f31397ec-5acf-4a90-a500-280a47ed1f55 on hv-cinder-85427 Aug 24 08:00:00.735455 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-922a1a8f-3853-41d3-9872-6911685626db req-54534a71-59ac-43e4-acbb-ce2826247cfd service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062356 Aug 24 08:00:00.740222 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 269/533] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:00:01.117432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-f12e07ee-2e8c-4716-ada8-5755b5f89653 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:01.118049 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-f12e07ee-2e8c-4716-ada8-5755b5f89653 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:01.125580 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f12e07ee-2e8c-4716-ada8-5755b5f89653 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:01.126064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f12e07ee-2e8c-4716-ada8-5755b5f89653 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:01.126500 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f12e07ee-2e8c-4716-ada8-5755b5f89653 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:01.127209 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f12e07ee-2e8c-4716-ada8-5755b5f89653 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:01.127666 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f12e07ee-2e8c-4716-ada8-5755b5f89653 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:01.128090 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f12e07ee-2e8c-4716-ada8-5755b5f89653 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:01.141462 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-f12e07ee-2e8c-4716-ada8-5755b5f89653 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] HTTP exception thrown: Instance a266e179-03cc-40b3-902d-aab680174711 could not be found. Aug 24 08:00:01.143733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-f12e07ee-2e8c-4716-ada8-5755b5f89653 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Request method failure captured: Aug 24 08:00:01.143733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 HTTP/1.1 Aug 24 08:00:01.143733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 08:00:01.143733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 08:00:01.143733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 08:00:01.143733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 08:00:01.143733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 08:00:01.143733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 08:00:01.143733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 08:00:01.143733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 08:00:01.143733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdl3cKStCm1Zlm946IP-OitNI5HL6KiJ_bhgRgPg58Easkt4DSp-7URwaFSBSjLAiKPQW0zOaKxelBjerZX7aKdzDYdpzLo0vYdbNyRxU1JeTRXQY6XHsyVrl0hBgC4KO8dvdovOPrkhjLqdnJJIEEDxrmUdrhdm1B1Av9eMoD5jzq0 Aug 24 08:00:01.143733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 08:00:01.143733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 08:00:01.143733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 08:00:01.143733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 08:00:01.143733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 08:00:01.143733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 08:00:01.143733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 08:00:01.143733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: 27c8e372420a4076b855d46a4f8ff521 Aug 24 08:00:01.143733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-815520547 Aug 24 08:00:01.143733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 08:00:01.143733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 08:00:01.145367 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_27c8e372420a4076b855d46a4f8ff521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/27c8e372420a4076b855d46a4f8ff521"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27c8e372420a4076b855d46a4f8ff521"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27c8e372420a4076b855d46a4f8ff521"}]}] Aug 24 08:00:01.145367 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-AttachVolumeShelveTestJSON-815520547 Aug 24 08:00:01.145367 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: 27c8e372420a4076b855d46a4f8ff521 Aug 24 08:00:01.145367 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-815520547 Aug 24 08:00:01.145367 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-AttachVolumeShelveTestJSON-815520547-project Aug 24 08:00:01.145367 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 08:00:01.145367 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 08:00:01.145367 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: d318793a5fee43bdb1a043b30396884b Aug 24 08:00:01.145367 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-AttachVolumeShelveTestJSON-815520547-project Aug 24 08:00:01.145367 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 08:00:01.145367 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Instance a266e179-03cc-40b3-902d-aab680174711 could not be found. Aug 24 08:00:01.145367 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': 'a266e179-03cc-40b3-902d-aab680174711'} Aug 24 08:00:01.146295 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:00:01.146295 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:00:01.146295 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:00:01.146295 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:00:01.146295 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:00:01.146295 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:00:01.146295 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:00:01.146295 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:00:01.146295 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:00:01.146295 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:00:01.146295 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a266e179-03cc-40b3-902d-aab680174711 could not be found. Aug 24 08:00:01.146295 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:00:01.146295 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:00:01.146295 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:00:01.146295 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:00:01.146295 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:00:01.146295 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:00:01.146295 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:00:01.146295 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:00:01.146295 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:00:01.147793 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:00:01.147793 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:00:01.147793 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:00:01.147793 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:00:01.147793 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:00:01.147793 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:00:01.147793 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:00:01.147793 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a266e179-03cc-40b3-902d-aab680174711 could not be found. Aug 24 08:00:01.147793 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:00:01.147793 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:00:01.147793 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:00:01.147793 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:00:01.147793 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:00:01.147793 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:00:01.147793 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:00:01.147793 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:00:01.147793 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a266e179-03cc-40b3-902d-aab680174711 could not be found. Aug 24 08:00:01.147793 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:00:01.148987 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-f12e07ee-2e8c-4716-ada8-5755b5f89653 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Returning 404 to user: Instance a266e179-03cc-40b3-902d-aab680174711 could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:00:01.148987 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-f12e07ee-2e8c-4716-ada8-5755b5f89653 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 404 len: 111 microversion: 2.20 time: 0.031694 Aug 24 08:00:01.154649 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-f94ac8f1-d734-449f-8ae4-4df95cc029e9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '.version_select at 0x7f320c2ccaf0>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:01.159260 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 265/534] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:01 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 08:00:01.226634 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-f94ac8f1-d734-449f-8ae4-4df95cc029e9 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1678806733" status: 204 len: 0 microversion: 2.20 time: 0.076081 Aug 24 08:00:01.231580 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 270/535] 10.222.0.72 () {60 vars in 1262 bytes} [Wed Aug 24 08:00:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1678806733 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 08:00:01.628250 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-246d7fc5-435a-4a17-b433-73be20153efa tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:01.629585 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-246d7fc5-435a-4a17-b433-73be20153efa tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:01.636587 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-246d7fc5-435a-4a17-b433-73be20153efa tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:01.637899 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-246d7fc5-435a-4a17-b433-73be20153efa tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:01.638781 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-246d7fc5-435a-4a17-b433-73be20153efa tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:01.639700 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-246d7fc5-435a-4a17-b433-73be20153efa tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:01.640349 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-246d7fc5-435a-4a17-b433-73be20153efa tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:01.640999 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-246d7fc5-435a-4a17-b433-73be20153efa tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:01.718407 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-246d7fc5-435a-4a17-b433-73be20153efa tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:01.726681 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-246d7fc5-435a-4a17-b433-73be20153efa tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1255 microversion: 2.1 time: 0.102365 Aug 24 08:00:01.727247 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 266/536] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:01 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1255 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:02.194852 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-0b70013c-270d-4bb5-bbbb-f9dca08edecd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Action: 'create', calling method: .version_select at 0x7f320c2f1280>, body: {"keypair": {"name": "tempest-keypair-1906892412", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/tUf3eh90lNUj2S9J4+Y21XaR7I7bEGkXg3xhAix7MLgu7dB3mzVXYdU3pwRfP3f1KBj35DSahqeGjCBSC3TMSV9kp8wNUCYa38l4X6LjsoSO88yoTuS2MjgWhnxbCYQ=="}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:00:02.210669 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-0b70013c-270d-4bb5-bbbb-f9dca08edecd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Getting quotas for project 27c8e372420a4076b855d46a4f8ff521. Resources: {'key_pairs'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:00:02.215027 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-0b70013c-270d-4bb5-bbbb-f9dca08edecd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Getting quotas for user d318793a5fee43bdb1a043b30396884b and project 27c8e372420a4076b855d46a4f8ff521. Resources: {'key_pairs'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:00:02.312106 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-0b70013c-270d-4bb5-bbbb-f9dca08edecd tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.121548 Aug 24 08:00:02.312633 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 271/537] 10.222.0.72 () {62 vars in 1200 bytes} [Wed Aug 24 08:00:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 123 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 24 08:00:02.749002 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-5f8722ad-958a-4162-9660-49eeb78fa6f3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:02.750272 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-5f8722ad-958a-4162-9660-49eeb78fa6f3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:02.751317 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-47625e23-1ef0-48ba-b2b1-deb18807c84d req-b3359ca0-ea76-413d-a0fd-df38127daf7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f31397ec-5acf-4a90-a500-280a47ed1f55", "tag": "8acdda10-43f7-423f-9513-4deb10644221"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:00:02.757897 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5f8722ad-958a-4162-9660-49eeb78fa6f3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:02.758516 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5f8722ad-958a-4162-9660-49eeb78fa6f3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:02.759623 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5f8722ad-958a-4162-9660-49eeb78fa6f3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:02.760470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5f8722ad-958a-4162-9660-49eeb78fa6f3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:02.761192 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5f8722ad-958a-4162-9660-49eeb78fa6f3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:02.762486 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5f8722ad-958a-4162-9660-49eeb78fa6f3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:02.763521 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-47625e23-1ef0-48ba-b2b1-deb18807c84d req-b3359ca0-ea76-413d-a0fd-df38127daf7e service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:02.764194 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-47625e23-1ef0-48ba-b2b1-deb18807c84d req-b3359ca0-ea76-413d-a0fd-df38127daf7e service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:02.764865 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-47625e23-1ef0-48ba-b2b1-deb18807c84d req-b3359ca0-ea76-413d-a0fd-df38127daf7e service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:02.780320 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-47625e23-1ef0-48ba-b2b1-deb18807c84d req-b3359ca0-ea76-413d-a0fd-df38127daf7e service nova] Creating event network-changed:8acdda10-43f7-423f-9513-4deb10644221 for instance f31397ec-5acf-4a90-a500-280a47ed1f55 on hv-cinder-85427 Aug 24 08:00:02.786797 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-47625e23-1ef0-48ba-b2b1-deb18807c84d req-b3359ca0-ea76-413d-a0fd-df38127daf7e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039066 Aug 24 08:00:02.787689 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 272/538] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:00:02.844837 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-5f8722ad-958a-4162-9660-49eeb78fa6f3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:02.854075 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-5f8722ad-958a-4162-9660-49eeb78fa6f3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1319 microversion: 2.1 time: 0.109006 Aug 24 08:00:02.855854 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 267/539] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:02 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1319 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:03.885674 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-88bdfe25-cfc0-432e-b279-12c58a402a1c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:03.887202 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-88bdfe25-cfc0-432e-b279-12c58a402a1c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:03.898861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-88bdfe25-cfc0-432e-b279-12c58a402a1c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:03.899453 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-88bdfe25-cfc0-432e-b279-12c58a402a1c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:03.900125 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-88bdfe25-cfc0-432e-b279-12c58a402a1c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:03.902992 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-88bdfe25-cfc0-432e-b279-12c58a402a1c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:03.903800 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-88bdfe25-cfc0-432e-b279-12c58a402a1c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:03.904705 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-88bdfe25-cfc0-432e-b279-12c58a402a1c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:04.098888 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-88bdfe25-cfc0-432e-b279-12c58a402a1c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:04.109978 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-88bdfe25-cfc0-432e-b279-12c58a402a1c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1359 microversion: 2.1 time: 0.232636 Aug 24 08:00:04.111140 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 273/540] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:03 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1359 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:05.133412 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-6c289b4a-3450-41f8-be04-2e6ff3094129 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:05.134065 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-6c289b4a-3450-41f8-be04-2e6ff3094129 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:05.140928 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6c289b4a-3450-41f8-be04-2e6ff3094129 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:05.141421 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6c289b4a-3450-41f8-be04-2e6ff3094129 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:05.141872 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6c289b4a-3450-41f8-be04-2e6ff3094129 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:05.142579 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6c289b4a-3450-41f8-be04-2e6ff3094129 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:05.143153 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6c289b4a-3450-41f8-be04-2e6ff3094129 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:05.143454 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6c289b4a-3450-41f8-be04-2e6ff3094129 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:05.291969 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-cfbee49c-dfce-406c-8236-896b4bbbcf5f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1077693105", "imageRef": "ccdab334-55ce-4ff5-bd97-5a424660c282", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dac6160e-2a1d-42ce-8220-e6f39a4fb0ee"}], "security_groups": [{"name": "tempest-securitygroup--729586249"}], "key_name": "tempest-keypair-1906892412", "user_data": "}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:00:05.321587 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-6c289b4a-3450-41f8-be04-2e6ff3094129 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:05.330746 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-6c289b4a-3450-41f8-be04-2e6ff3094129 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1359 microversion: 2.1 time: 0.201266 Aug 24 08:00:05.331879 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 268/541] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:05 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1359 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:05.421520 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.network.neutron [None req-cfbee49c-dfce-406c-8236-896b4bbbcf5f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] validate_networks() for [('dac6160e-2a1d-42ce-8220-e6f39a4fb0ee', None, None, None, None, None)] {{(pid=127590) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:00:05.831660 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-cfbee49c-dfce-406c-8236-896b4bbbcf5f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Flavor limits 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:00:05.832091 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-cfbee49c-dfce-406c-8236-896b4bbbcf5f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Image limits 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:00:05.832567 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-cfbee49c-dfce-406c-8236-896b4bbbcf5f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Flavor pref 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:00:05.833006 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-cfbee49c-dfce-406c-8236-896b4bbbcf5f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Image pref 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:00:05.833421 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-cfbee49c-dfce-406c-8236-896b4bbbcf5f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:00:05.843286 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cfbee49c-dfce-406c-8236-896b4bbbcf5f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:05.843833 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cfbee49c-dfce-406c-8236-896b4bbbcf5f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:05.844267 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cfbee49c-dfce-406c-8236-896b4bbbcf5f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:05.845072 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cfbee49c-dfce-406c-8236-896b4bbbcf5f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:05.845574 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cfbee49c-dfce-406c-8236-896b4bbbcf5f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:05.846180 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cfbee49c-dfce-406c-8236-896b4bbbcf5f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:05.863951 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-cfbee49c-dfce-406c-8236-896b4bbbcf5f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Getting quotas for project 27c8e372420a4076b855d46a4f8ff521. Resources: {'cores', 'instances', 'ram'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:00:05.867902 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-cfbee49c-dfce-406c-8236-896b4bbbcf5f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Getting quotas for user d318793a5fee43bdb1a043b30396884b and project 27c8e372420a4076b855d46a4f8ff521. Resources: {'cores', 'instances', 'ram'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:00:05.879451 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-cfbee49c-dfce-406c-8236-896b4bbbcf5f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Going to run 1 instances... {{(pid=127590) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:00:05.881792 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-cfbee49c-dfce-406c-8236-896b4bbbcf5f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccdab334-55ce-4ff5-bd97-5a424660c282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:00:06.025514 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-cfbee49c-dfce-406c-8236-896b4bbbcf5f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.740034 Aug 24 08:00:06.026157 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 274/542] 10.222.0.72 () {62 vars in 1188 bytes} [Wed Aug 24 08:00:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 08:00:06.037347 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-375980ef-0ace-43ae-85a2-7ad4a04acb6a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:06.037963 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-375980ef-0ace-43ae-85a2-7ad4a04acb6a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:06.102112 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-375980ef-0ace-43ae-85a2-7ad4a04acb6a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:06.110910 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-375980ef-0ace-43ae-85a2-7ad4a04acb6a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:06.112498 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-375980ef-0ace-43ae-85a2-7ad4a04acb6a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:06.113927 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-375980ef-0ace-43ae-85a2-7ad4a04acb6a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1282 microversion: 2.20 time: 0.080504 Aug 24 08:00:06.114652 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 269/543] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:06 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1282 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:06.351638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-4f9a3b20-438c-463c-96aa-3dd52f60873a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:06.352877 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-4f9a3b20-438c-463c-96aa-3dd52f60873a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:06.362669 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4f9a3b20-438c-463c-96aa-3dd52f60873a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:06.363159 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4f9a3b20-438c-463c-96aa-3dd52f60873a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:06.363602 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4f9a3b20-438c-463c-96aa-3dd52f60873a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:06.364307 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4f9a3b20-438c-463c-96aa-3dd52f60873a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:06.364997 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4f9a3b20-438c-463c-96aa-3dd52f60873a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:06.365462 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4f9a3b20-438c-463c-96aa-3dd52f60873a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:06.510116 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-4f9a3b20-438c-463c-96aa-3dd52f60873a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:06.519840 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-4f9a3b20-438c-463c-96aa-3dd52f60873a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1359 microversion: 2.1 time: 0.171331 Aug 24 08:00:06.519840 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 275/544] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:06 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:07.137371 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-bd97850e-f3c5-41ee-a700-7c17afde9a6f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:07.138595 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-bd97850e-f3c5-41ee-a700-7c17afde9a6f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:07.146426 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bd97850e-f3c5-41ee-a700-7c17afde9a6f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:07.146910 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bd97850e-f3c5-41ee-a700-7c17afde9a6f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:07.147374 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bd97850e-f3c5-41ee-a700-7c17afde9a6f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:07.148052 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bd97850e-f3c5-41ee-a700-7c17afde9a6f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:07.148501 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bd97850e-f3c5-41ee-a700-7c17afde9a6f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:07.148950 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bd97850e-f3c5-41ee-a700-7c17afde9a6f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:07.211714 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-bd97850e-f3c5-41ee-a700-7c17afde9a6f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:07.220498 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-bd97850e-f3c5-41ee-a700-7c17afde9a6f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:07.222046 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-bd97850e-f3c5-41ee-a700-7c17afde9a6f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:07.223204 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-bd97850e-f3c5-41ee-a700-7c17afde9a6f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1286 microversion: 2.20 time: 0.089991 Aug 24 08:00:07.223766 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 270/545] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:07 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:00:07.541758 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-94f19037-a83c-4e0a-bc43-7047ca3c747a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:07.542488 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-94f19037-a83c-4e0a-bc43-7047ca3c747a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:07.549456 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-94f19037-a83c-4e0a-bc43-7047ca3c747a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:07.549948 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-94f19037-a83c-4e0a-bc43-7047ca3c747a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:07.550381 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-94f19037-a83c-4e0a-bc43-7047ca3c747a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:07.551073 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-94f19037-a83c-4e0a-bc43-7047ca3c747a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:07.551568 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-94f19037-a83c-4e0a-bc43-7047ca3c747a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:07.551981 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-94f19037-a83c-4e0a-bc43-7047ca3c747a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:07.690908 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-94f19037-a83c-4e0a-bc43-7047ca3c747a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:07.698558 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-94f19037-a83c-4e0a-bc43-7047ca3c747a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1359 microversion: 2.1 time: 0.160642 Aug 24 08:00:07.699775 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 276/546] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:07 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:08.245626 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-a438b78f-7b46-423f-bef5-ccc9b441a6b7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:08.246277 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-a438b78f-7b46-423f-bef5-ccc9b441a6b7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:08.252723 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a438b78f-7b46-423f-bef5-ccc9b441a6b7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:08.253216 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a438b78f-7b46-423f-bef5-ccc9b441a6b7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:08.253656 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a438b78f-7b46-423f-bef5-ccc9b441a6b7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:08.254350 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a438b78f-7b46-423f-bef5-ccc9b441a6b7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:08.254827 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a438b78f-7b46-423f-bef5-ccc9b441a6b7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:08.255230 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a438b78f-7b46-423f-bef5-ccc9b441a6b7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:08.329727 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a438b78f-7b46-423f-bef5-ccc9b441a6b7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:08.338563 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a438b78f-7b46-423f-bef5-ccc9b441a6b7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:08.340595 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a438b78f-7b46-423f-bef5-ccc9b441a6b7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:08.341819 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-a438b78f-7b46-423f-bef5-ccc9b441a6b7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1286 microversion: 2.20 time: 0.100181 Aug 24 08:00:08.342367 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 271/547] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:08 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:08.720096 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-2b347e74-7f20-4c90-8b0a-1ae7611803c6 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:08.720934 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-2b347e74-7f20-4c90-8b0a-1ae7611803c6 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:08.728201 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2b347e74-7f20-4c90-8b0a-1ae7611803c6 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:08.728706 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2b347e74-7f20-4c90-8b0a-1ae7611803c6 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:08.729147 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2b347e74-7f20-4c90-8b0a-1ae7611803c6 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:08.729852 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2b347e74-7f20-4c90-8b0a-1ae7611803c6 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:08.730298 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2b347e74-7f20-4c90-8b0a-1ae7611803c6 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:08.730714 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2b347e74-7f20-4c90-8b0a-1ae7611803c6 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:08.871462 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-2b347e74-7f20-4c90-8b0a-1ae7611803c6 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:08.879583 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-2b347e74-7f20-4c90-8b0a-1ae7611803c6 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1359 microversion: 2.1 time: 0.163352 Aug 24 08:00:08.880153 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 277/548] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:08 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:09.365586 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b075f56c-9232-4469-a528-66ef07fc88b7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:09.366205 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-b075f56c-9232-4469-a528-66ef07fc88b7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:09.368950 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=2 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:09.375734 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b075f56c-9232-4469-a528-66ef07fc88b7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:09.376311 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b075f56c-9232-4469-a528-66ef07fc88b7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:09.376784 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b075f56c-9232-4469-a528-66ef07fc88b7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:09.377580 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b075f56c-9232-4469-a528-66ef07fc88b7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:09.378078 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b075f56c-9232-4469-a528-66ef07fc88b7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:09.378508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b075f56c-9232-4469-a528-66ef07fc88b7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:09.446902 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b075f56c-9232-4469-a528-66ef07fc88b7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:09.449435 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:09.457546 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b075f56c-9232-4469-a528-66ef07fc88b7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:09.459091 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b075f56c-9232-4469-a528-66ef07fc88b7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:09.460203 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-b075f56c-9232-4469-a528-66ef07fc88b7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1286 microversion: 2.20 time: 0.099049 Aug 24 08:00:09.461004 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 272/549] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:09 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:09.907279 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-129bd73b-3eb5-43a4-8e44-3b876c357d26 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:09.908253 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-129bd73b-3eb5-43a4-8e44-3b876c357d26 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:09.915219 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-129bd73b-3eb5-43a4-8e44-3b876c357d26 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:09.915830 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-129bd73b-3eb5-43a4-8e44-3b876c357d26 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:09.916576 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-129bd73b-3eb5-43a4-8e44-3b876c357d26 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:09.917335 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-129bd73b-3eb5-43a4-8e44-3b876c357d26 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:09.918463 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-129bd73b-3eb5-43a4-8e44-3b876c357d26 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:09.918903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-129bd73b-3eb5-43a4-8e44-3b876c357d26 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:10.059753 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-129bd73b-3eb5-43a4-8e44-3b876c357d26 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:10.068752 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-129bd73b-3eb5-43a4-8e44-3b876c357d26 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1359 microversion: 2.1 time: 0.165299 Aug 24 08:00:10.069338 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 278/550] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:09 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:10.482381 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-ff7e6ad1-3b22-479d-8b16-35edb51deb48 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:10.483012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-ff7e6ad1-3b22-479d-8b16-35edb51deb48 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:10.490691 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ff7e6ad1-3b22-479d-8b16-35edb51deb48 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:10.491176 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ff7e6ad1-3b22-479d-8b16-35edb51deb48 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:10.491614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ff7e6ad1-3b22-479d-8b16-35edb51deb48 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:10.492311 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ff7e6ad1-3b22-479d-8b16-35edb51deb48 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:10.492793 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ff7e6ad1-3b22-479d-8b16-35edb51deb48 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:10.493222 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ff7e6ad1-3b22-479d-8b16-35edb51deb48 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:10.560056 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-ff7e6ad1-3b22-479d-8b16-35edb51deb48 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:10.568419 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-ff7e6ad1-3b22-479d-8b16-35edb51deb48 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:10.569940 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-ff7e6ad1-3b22-479d-8b16-35edb51deb48 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:10.571051 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-ff7e6ad1-3b22-479d-8b16-35edb51deb48 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1286 microversion: 2.20 time: 0.092562 Aug 24 08:00:10.571600 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 273/551] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:10 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:11.089203 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-928aa534-9d65-457a-8311-fc4ac3890b06 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:11.090402 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-928aa534-9d65-457a-8311-fc4ac3890b06 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:11.097441 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-928aa534-9d65-457a-8311-fc4ac3890b06 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:11.097986 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-928aa534-9d65-457a-8311-fc4ac3890b06 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:11.098425 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-928aa534-9d65-457a-8311-fc4ac3890b06 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:11.099287 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-928aa534-9d65-457a-8311-fc4ac3890b06 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:11.099738 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-928aa534-9d65-457a-8311-fc4ac3890b06 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:11.100159 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-928aa534-9d65-457a-8311-fc4ac3890b06 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:11.250387 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-928aa534-9d65-457a-8311-fc4ac3890b06 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:11.258245 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-928aa534-9d65-457a-8311-fc4ac3890b06 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1359 microversion: 2.1 time: 0.172780 Aug 24 08:00:11.260839 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 279/552] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:11 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:11.596382 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-03040d8a-606f-4e80-b0c5-000b28a9d878 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:11.597698 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-03040d8a-606f-4e80-b0c5-000b28a9d878 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:11.603708 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-03040d8a-606f-4e80-b0c5-000b28a9d878 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:11.604197 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-03040d8a-606f-4e80-b0c5-000b28a9d878 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:11.604626 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-03040d8a-606f-4e80-b0c5-000b28a9d878 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:11.605495 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-03040d8a-606f-4e80-b0c5-000b28a9d878 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:11.605942 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-03040d8a-606f-4e80-b0c5-000b28a9d878 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:11.606363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-03040d8a-606f-4e80-b0c5-000b28a9d878 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:11.667418 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-03040d8a-606f-4e80-b0c5-000b28a9d878 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:11.676512 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-03040d8a-606f-4e80-b0c5-000b28a9d878 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:11.678024 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-03040d8a-606f-4e80-b0c5-000b28a9d878 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:11.679113 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-03040d8a-606f-4e80-b0c5-000b28a9d878 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1286 microversion: 2.20 time: 0.087966 Aug 24 08:00:11.679651 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 274/553] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:11 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:00:12.281394 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-fda4e37d-8056-4100-9924-2547876e65b8 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:12.283097 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-fda4e37d-8056-4100-9924-2547876e65b8 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:12.290261 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fda4e37d-8056-4100-9924-2547876e65b8 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:12.290752 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fda4e37d-8056-4100-9924-2547876e65b8 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:12.291218 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fda4e37d-8056-4100-9924-2547876e65b8 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:12.291918 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fda4e37d-8056-4100-9924-2547876e65b8 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:12.292371 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fda4e37d-8056-4100-9924-2547876e65b8 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:12.293423 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fda4e37d-8056-4100-9924-2547876e65b8 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:12.440441 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-fda4e37d-8056-4100-9924-2547876e65b8 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:12.454441 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-fda4e37d-8056-4100-9924-2547876e65b8 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1359 microversion: 2.1 time: 0.178523 Aug 24 08:00:12.455022 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 280/554] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:12 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:12.704824 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-d1c409a2-af48-4c4e-b679-3786ac25bb33 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:12.705936 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-d1c409a2-af48-4c4e-b679-3786ac25bb33 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:12.711805 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d1c409a2-af48-4c4e-b679-3786ac25bb33 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:12.712285 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d1c409a2-af48-4c4e-b679-3786ac25bb33 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:12.712740 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d1c409a2-af48-4c4e-b679-3786ac25bb33 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:12.713424 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d1c409a2-af48-4c4e-b679-3786ac25bb33 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:12.713879 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d1c409a2-af48-4c4e-b679-3786ac25bb33 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:12.714316 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d1c409a2-af48-4c4e-b679-3786ac25bb33 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:12.778170 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-d1c409a2-af48-4c4e-b679-3786ac25bb33 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:12.786734 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-d1c409a2-af48-4c4e-b679-3786ac25bb33 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:12.791801 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-d1c409a2-af48-4c4e-b679-3786ac25bb33 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:12.791801 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-d1c409a2-af48-4c4e-b679-3786ac25bb33 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1286 microversion: 2.20 time: 0.089130 Aug 24 08:00:12.791801 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 275/555] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:12 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:13.475653 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-233c2019-27cb-408b-ae43-62fe7cb737e3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:13.476544 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-233c2019-27cb-408b-ae43-62fe7cb737e3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:13.494972 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-233c2019-27cb-408b-ae43-62fe7cb737e3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:13.496246 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-233c2019-27cb-408b-ae43-62fe7cb737e3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:13.501308 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-233c2019-27cb-408b-ae43-62fe7cb737e3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:13.501308 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-233c2019-27cb-408b-ae43-62fe7cb737e3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:13.501308 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-233c2019-27cb-408b-ae43-62fe7cb737e3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:13.501308 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-233c2019-27cb-408b-ae43-62fe7cb737e3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:13.637303 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-233c2019-27cb-408b-ae43-62fe7cb737e3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:13.645800 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-233c2019-27cb-408b-ae43-62fe7cb737e3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1359 microversion: 2.1 time: 0.174293 Aug 24 08:00:13.646362 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 281/556] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:13 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:00:13.811482 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-6e5c69b1-a141-4e17-aa51-7963fa507ab2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:13.812096 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-6e5c69b1-a141-4e17-aa51-7963fa507ab2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:13.818640 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6e5c69b1-a141-4e17-aa51-7963fa507ab2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:13.819127 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6e5c69b1-a141-4e17-aa51-7963fa507ab2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:13.819572 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6e5c69b1-a141-4e17-aa51-7963fa507ab2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:13.820271 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6e5c69b1-a141-4e17-aa51-7963fa507ab2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:13.820749 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6e5c69b1-a141-4e17-aa51-7963fa507ab2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:13.821227 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6e5c69b1-a141-4e17-aa51-7963fa507ab2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:13.883137 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-6e5c69b1-a141-4e17-aa51-7963fa507ab2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:13.891823 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-6e5c69b1-a141-4e17-aa51-7963fa507ab2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:13.893370 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-6e5c69b1-a141-4e17-aa51-7963fa507ab2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:13.894460 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-6e5c69b1-a141-4e17-aa51-7963fa507ab2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1286 microversion: 2.20 time: 0.087043 Aug 24 08:00:13.895008 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 276/557] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:13 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:14.667292 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-bf1c8c65-0c77-4991-9c5e-aadd12954062 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:14.667902 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-bf1c8c65-0c77-4991-9c5e-aadd12954062 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:14.674359 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bf1c8c65-0c77-4991-9c5e-aadd12954062 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:14.674842 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bf1c8c65-0c77-4991-9c5e-aadd12954062 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:14.675313 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bf1c8c65-0c77-4991-9c5e-aadd12954062 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:14.676010 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bf1c8c65-0c77-4991-9c5e-aadd12954062 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:14.676463 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bf1c8c65-0c77-4991-9c5e-aadd12954062 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:14.676917 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bf1c8c65-0c77-4991-9c5e-aadd12954062 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:14.804311 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-bf1c8c65-0c77-4991-9c5e-aadd12954062 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:14.812518 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-bf1c8c65-0c77-4991-9c5e-aadd12954062 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1359 microversion: 2.1 time: 0.149168 Aug 24 08:00:14.813101 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 282/558] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:14 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:14.917179 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-28dd1ae0-7516-46f6-8afd-d3eff220b1c2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:14.918548 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-28dd1ae0-7516-46f6-8afd-d3eff220b1c2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:14.924833 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-28dd1ae0-7516-46f6-8afd-d3eff220b1c2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:14.925314 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-28dd1ae0-7516-46f6-8afd-d3eff220b1c2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:14.925746 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-28dd1ae0-7516-46f6-8afd-d3eff220b1c2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:14.926432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-28dd1ae0-7516-46f6-8afd-d3eff220b1c2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:14.926880 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-28dd1ae0-7516-46f6-8afd-d3eff220b1c2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:14.927294 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-28dd1ae0-7516-46f6-8afd-d3eff220b1c2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:14.991825 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-28dd1ae0-7516-46f6-8afd-d3eff220b1c2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:15.000321 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-28dd1ae0-7516-46f6-8afd-d3eff220b1c2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:15.001886 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-28dd1ae0-7516-46f6-8afd-d3eff220b1c2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:15.003120 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-28dd1ae0-7516-46f6-8afd-d3eff220b1c2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1286 microversion: 2.20 time: 0.089679 Aug 24 08:00:15.003552 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 277/559] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:14 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:15.833114 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-1e2cb4bc-0cfd-4126-9057-201729f1b90f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:15.833762 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-1e2cb4bc-0cfd-4126-9057-201729f1b90f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:15.836193 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:15.841713 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1e2cb4bc-0cfd-4126-9057-201729f1b90f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:15.842225 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1e2cb4bc-0cfd-4126-9057-201729f1b90f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:15.842664 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1e2cb4bc-0cfd-4126-9057-201729f1b90f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:15.843365 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1e2cb4bc-0cfd-4126-9057-201729f1b90f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:15.843822 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1e2cb4bc-0cfd-4126-9057-201729f1b90f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:15.844249 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1e2cb4bc-0cfd-4126-9057-201729f1b90f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:15.859735 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=2 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:15.880000 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=16 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:15.988037 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-1e2cb4bc-0cfd-4126-9057-201729f1b90f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:15.996109 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-1e2cb4bc-0cfd-4126-9057-201729f1b90f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1359 microversion: 2.1 time: 0.166379 Aug 24 08:00:15.996815 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 283/560] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:15 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:16.025877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-07b9f3f3-8133-479f-ae85-2b1cd16ae189 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:16.026478 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-07b9f3f3-8133-479f-ae85-2b1cd16ae189 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:16.028423 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:16.033404 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-07b9f3f3-8133-479f-ae85-2b1cd16ae189 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:16.033889 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-07b9f3f3-8133-479f-ae85-2b1cd16ae189 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:16.034316 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-07b9f3f3-8133-479f-ae85-2b1cd16ae189 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:16.035001 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-07b9f3f3-8133-479f-ae85-2b1cd16ae189 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:16.035819 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-07b9f3f3-8133-479f-ae85-2b1cd16ae189 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:16.036286 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-07b9f3f3-8133-479f-ae85-2b1cd16ae189 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:16.097212 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-07b9f3f3-8133-479f-ae85-2b1cd16ae189 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:16.106162 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-07b9f3f3-8133-479f-ae85-2b1cd16ae189 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:16.107656 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-07b9f3f3-8133-479f-ae85-2b1cd16ae189 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:16.108770 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-07b9f3f3-8133-479f-ae85-2b1cd16ae189 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1286 microversion: 2.20 time: 0.087203 Aug 24 08:00:16.109314 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 278/561] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:16 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:16.969472 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-b7ff790d-eba2-44b1-a5ba-7cd7480a5f35 req-0d9c50f9-221e-4c81-9a44-f1994dc9eea3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86d751e5-15c5-4cbb-a9af-711aab6bee68", "tag": "f9f1b354-6f60-423b-8ee3-6fff02486c95"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:00:16.979308 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-b7ff790d-eba2-44b1-a5ba-7cd7480a5f35 req-0d9c50f9-221e-4c81-9a44-f1994dc9eea3 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:16.980355 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-b7ff790d-eba2-44b1-a5ba-7cd7480a5f35 req-0d9c50f9-221e-4c81-9a44-f1994dc9eea3 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:16.980979 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-b7ff790d-eba2-44b1-a5ba-7cd7480a5f35 req-0d9c50f9-221e-4c81-9a44-f1994dc9eea3 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:16.991655 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-b7ff790d-eba2-44b1-a5ba-7cd7480a5f35 req-0d9c50f9-221e-4c81-9a44-f1994dc9eea3 service nova] Creating event network-changed:f9f1b354-6f60-423b-8ee3-6fff02486c95 for instance 86d751e5-15c5-4cbb-a9af-711aab6bee68 on hv-cinder-85427 Aug 24 08:00:16.997443 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-b7ff790d-eba2-44b1-a5ba-7cd7480a5f35 req-0d9c50f9-221e-4c81-9a44-f1994dc9eea3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031880 Aug 24 08:00:16.998037 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 284/562] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:00:17.019674 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-5820cccc-a3ee-48df-af3a-7ca1a620186a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:17.020631 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-5820cccc-a3ee-48df-af3a-7ca1a620186a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:17.026920 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=10 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:17.028111 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5820cccc-a3ee-48df-af3a-7ca1a620186a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:17.028413 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5820cccc-a3ee-48df-af3a-7ca1a620186a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:17.028884 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5820cccc-a3ee-48df-af3a-7ca1a620186a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:17.029600 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5820cccc-a3ee-48df-af3a-7ca1a620186a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:17.030050 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5820cccc-a3ee-48df-af3a-7ca1a620186a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:17.030493 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5820cccc-a3ee-48df-af3a-7ca1a620186a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:17.131785 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-cae0b1e8-e70d-4d7b-b5f3-bc0715556b11 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:17.132467 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-cae0b1e8-e70d-4d7b-b5f3-bc0715556b11 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:17.138445 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cae0b1e8-e70d-4d7b-b5f3-bc0715556b11 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:17.138922 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cae0b1e8-e70d-4d7b-b5f3-bc0715556b11 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:17.139352 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cae0b1e8-e70d-4d7b-b5f3-bc0715556b11 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:17.140048 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cae0b1e8-e70d-4d7b-b5f3-bc0715556b11 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:17.140503 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cae0b1e8-e70d-4d7b-b5f3-bc0715556b11 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:17.140936 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cae0b1e8-e70d-4d7b-b5f3-bc0715556b11 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:17.156279 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=100 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:17.161811 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-5820cccc-a3ee-48df-af3a-7ca1a620186a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:17.170193 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-5820cccc-a3ee-48df-af3a-7ca1a620186a tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1359 microversion: 2.1 time: 0.156374 Aug 24 08:00:17.170763 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 279/563] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:17 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:17.210258 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-cae0b1e8-e70d-4d7b-b5f3-bc0715556b11 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:17.222855 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-cae0b1e8-e70d-4d7b-b5f3-bc0715556b11 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:17.223804 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-cae0b1e8-e70d-4d7b-b5f3-bc0715556b11 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:17.225527 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-cae0b1e8-e70d-4d7b-b5f3-bc0715556b11 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1334 microversion: 2.20 time: 0.097734 Aug 24 08:00:17.227687 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 285/564] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:17 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1334 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:00:18.190806 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-31911093-bfa8-49b8-870e-33a9c1761342 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:18.191500 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-31911093-bfa8-49b8-870e-33a9c1761342 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:18.198256 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-31911093-bfa8-49b8-870e-33a9c1761342 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:18.198746 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-31911093-bfa8-49b8-870e-33a9c1761342 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:18.199211 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-31911093-bfa8-49b8-870e-33a9c1761342 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:18.199986 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-31911093-bfa8-49b8-870e-33a9c1761342 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:18.200439 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-31911093-bfa8-49b8-870e-33a9c1761342 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:18.200894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-31911093-bfa8-49b8-870e-33a9c1761342 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:18.259267 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-7b4352a2-8ec8-4ae1-b6d2-3b3cb53f9bdb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:18.259873 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-7b4352a2-8ec8-4ae1-b6d2-3b3cb53f9bdb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:18.278758 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7b4352a2-8ec8-4ae1-b6d2-3b3cb53f9bdb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:18.279260 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7b4352a2-8ec8-4ae1-b6d2-3b3cb53f9bdb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:18.279709 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7b4352a2-8ec8-4ae1-b6d2-3b3cb53f9bdb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:18.280432 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7b4352a2-8ec8-4ae1-b6d2-3b3cb53f9bdb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:18.280905 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7b4352a2-8ec8-4ae1-b6d2-3b3cb53f9bdb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:18.281331 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7b4352a2-8ec8-4ae1-b6d2-3b3cb53f9bdb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:18.381856 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-31911093-bfa8-49b8-870e-33a9c1761342 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:18.396945 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-31911093-bfa8-49b8-870e-33a9c1761342 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1359 microversion: 2.1 time: 0.209901 Aug 24 08:00:18.412166 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 280/565] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:18 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:18.485829 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-7b4352a2-8ec8-4ae1-b6d2-3b3cb53f9bdb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:18.501458 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-7b4352a2-8ec8-4ae1-b6d2-3b3cb53f9bdb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:18.502967 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-7b4352a2-8ec8-4ae1-b6d2-3b3cb53f9bdb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:18.504102 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-7b4352a2-8ec8-4ae1-b6d2-3b3cb53f9bdb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1407 microversion: 2.20 time: 0.249048 Aug 24 08:00:18.504687 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 286/566] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:18 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:00:19.418677 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-00213b40-74b1-4595-bcb3-ce99cdc87dd3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:19.419520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-00213b40-74b1-4595-bcb3-ce99cdc87dd3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:19.425434 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-00213b40-74b1-4595-bcb3-ce99cdc87dd3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:19.425923 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-00213b40-74b1-4595-bcb3-ce99cdc87dd3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:19.426361 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-00213b40-74b1-4595-bcb3-ce99cdc87dd3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:19.427066 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-00213b40-74b1-4595-bcb3-ce99cdc87dd3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:19.427520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-00213b40-74b1-4595-bcb3-ce99cdc87dd3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:19.427975 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-00213b40-74b1-4595-bcb3-ce99cdc87dd3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:19.527457 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-64e31e88-c083-4e7a-bacf-51ccbe7f1a31 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:19.532568 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-64e31e88-c083-4e7a-bacf-51ccbe7f1a31 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:19.536020 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-64e31e88-c083-4e7a-bacf-51ccbe7f1a31 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:19.536612 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-64e31e88-c083-4e7a-bacf-51ccbe7f1a31 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:19.537332 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-64e31e88-c083-4e7a-bacf-51ccbe7f1a31 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:19.538264 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-64e31e88-c083-4e7a-bacf-51ccbe7f1a31 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:19.538841 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-64e31e88-c083-4e7a-bacf-51ccbe7f1a31 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:19.539372 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-64e31e88-c083-4e7a-bacf-51ccbe7f1a31 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:19.564595 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-00213b40-74b1-4595-bcb3-ce99cdc87dd3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:19.574436 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-00213b40-74b1-4595-bcb3-ce99cdc87dd3 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1359 microversion: 2.1 time: 0.158909 Aug 24 08:00:19.575010 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 281/567] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:19 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:19.753756 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-64e31e88-c083-4e7a-bacf-51ccbe7f1a31 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:19.762842 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-64e31e88-c083-4e7a-bacf-51ccbe7f1a31 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:19.764700 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-64e31e88-c083-4e7a-bacf-51ccbe7f1a31 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:19.765821 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-64e31e88-c083-4e7a-bacf-51ccbe7f1a31 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1407 microversion: 2.20 time: 0.242287 Aug 24 08:00:19.766385 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 287/568] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:19 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:00:19.894979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-126cb482-4fd8-4a73-bf4e-204dcf4cacea req-c05f2e8b-7bc7-4c10-94ee-653bddc06770 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "771d249a-e50d-4848-b6ab-cb76685964d7", "tag": "f4073395-cdc8-42de-89a0-3e684efbce28"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:00:19.904730 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-126cb482-4fd8-4a73-bf4e-204dcf4cacea req-c05f2e8b-7bc7-4c10-94ee-653bddc06770 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:19.905215 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-126cb482-4fd8-4a73-bf4e-204dcf4cacea req-c05f2e8b-7bc7-4c10-94ee-653bddc06770 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:19.905650 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-126cb482-4fd8-4a73-bf4e-204dcf4cacea req-c05f2e8b-7bc7-4c10-94ee-653bddc06770 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:19.916959 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-126cb482-4fd8-4a73-bf4e-204dcf4cacea req-c05f2e8b-7bc7-4c10-94ee-653bddc06770 service nova] Creating event network-changed:f4073395-cdc8-42de-89a0-3e684efbce28 for instance 771d249a-e50d-4848-b6ab-cb76685964d7 on hv-cinder-85427 Aug 24 08:00:19.921937 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-126cb482-4fd8-4a73-bf4e-204dcf4cacea req-c05f2e8b-7bc7-4c10-94ee-653bddc06770 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030619 Aug 24 08:00:19.922466 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 282/569] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:00:20.594331 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-ad445d86-ea2c-4561-bf22-21485b75384f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:20.595098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-ad445d86-ea2c-4561-bf22-21485b75384f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:20.601664 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ad445d86-ea2c-4561-bf22-21485b75384f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:20.602144 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ad445d86-ea2c-4561-bf22-21485b75384f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:20.602578 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ad445d86-ea2c-4561-bf22-21485b75384f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:20.603273 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ad445d86-ea2c-4561-bf22-21485b75384f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:20.603725 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ad445d86-ea2c-4561-bf22-21485b75384f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:20.604145 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ad445d86-ea2c-4561-bf22-21485b75384f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:20.685201 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-f7cb0f22-582a-4c7d-ab72-f97a6a7780a2 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:20.692240 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-f7cb0f22-582a-4c7d-ab72-f97a6a7780a2 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:20.699486 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f7cb0f22-582a-4c7d-ab72-f97a6a7780a2 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:20.700219 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f7cb0f22-582a-4c7d-ab72-f97a6a7780a2 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:20.700758 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f7cb0f22-582a-4c7d-ab72-f97a6a7780a2 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:20.701385 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f7cb0f22-582a-4c7d-ab72-f97a6a7780a2 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:20.701987 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f7cb0f22-582a-4c7d-ab72-f97a6a7780a2 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:20.702566 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f7cb0f22-582a-4c7d-ab72-f97a6a7780a2 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:20.802077 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.objects.instance [None req-f7cb0f22-582a-4c7d-ab72-f97a6a7780a2 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lazy-loading 'services' on Instance uuid c96a75be-6264-4548-aa5d-a893ca4ef99e {{(pid=127589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:00:20.837241 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-ad445d86-ea2c-4561-bf22-21485b75384f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:20.853419 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-ad445d86-ea2c-4561-bf22-21485b75384f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1359 microversion: 2.1 time: 0.262475 Aug 24 08:00:20.854005 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 288/570] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:20 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1359 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:20.860875 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-a554eda7-b94e-4341-bcc7-9a7aba96f3ce tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:20.861724 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-a554eda7-b94e-4341-bcc7-9a7aba96f3ce tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:20.868126 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a554eda7-b94e-4341-bcc7-9a7aba96f3ce tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:20.868608 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a554eda7-b94e-4341-bcc7-9a7aba96f3ce tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:20.869066 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a554eda7-b94e-4341-bcc7-9a7aba96f3ce tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:20.869759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a554eda7-b94e-4341-bcc7-9a7aba96f3ce tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:20.870200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a554eda7-b94e-4341-bcc7-9a7aba96f3ce tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:20.871795 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a554eda7-b94e-4341-bcc7-9a7aba96f3ce tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:21.041129 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-a554eda7-b94e-4341-bcc7-9a7aba96f3ce tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:21.049920 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-a554eda7-b94e-4341-bcc7-9a7aba96f3ce tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:21.051418 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-a554eda7-b94e-4341-bcc7-9a7aba96f3ce tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:21.052513 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-a554eda7-b94e-4341-bcc7-9a7aba96f3ce tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1407 microversion: 2.20 time: 0.196735 Aug 24 08:00:21.053163 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 289/571] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:20 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:21.080487 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-f7cb0f22-582a-4c7d-ab72-f97a6a7780a2 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e/os-volume_attachments/3dd723d2-8a78-4ce5-a31a-dbf685249f82" status: 202 len: 0 microversion: 2.1 time: 0.399342 Aug 24 08:00:21.081101 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 283/572] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 24 08:00:20 2022] DELETE /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e/os-volume_attachments/3dd723d2-8a78-4ce5-a31a-dbf685249f82 => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 08:00:21.874836 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-ccd8f736-6161-46c5-9fa5-688e62e312df tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:21.875449 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-ccd8f736-6161-46c5-9fa5-688e62e312df tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:21.881914 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ccd8f736-6161-46c5-9fa5-688e62e312df tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:21.882399 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ccd8f736-6161-46c5-9fa5-688e62e312df tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:21.882843 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ccd8f736-6161-46c5-9fa5-688e62e312df tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:21.883533 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ccd8f736-6161-46c5-9fa5-688e62e312df tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:21.883988 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ccd8f736-6161-46c5-9fa5-688e62e312df tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:21.884420 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ccd8f736-6161-46c5-9fa5-688e62e312df tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:22.011255 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-ccd8f736-6161-46c5-9fa5-688e62e312df tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:22.018822 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-ccd8f736-6161-46c5-9fa5-688e62e312df tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1359 microversion: 2.1 time: 0.148349 Aug 24 08:00:22.019367 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 290/573] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:21 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:22.075936 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-8932c28d-797a-4166-be1b-3567f7d9dcf4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:22.076739 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-8932c28d-797a-4166-be1b-3567f7d9dcf4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:22.082993 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8932c28d-797a-4166-be1b-3567f7d9dcf4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:22.083474 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8932c28d-797a-4166-be1b-3567f7d9dcf4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:22.083910 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8932c28d-797a-4166-be1b-3567f7d9dcf4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:22.084604 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8932c28d-797a-4166-be1b-3567f7d9dcf4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:22.085082 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8932c28d-797a-4166-be1b-3567f7d9dcf4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:22.085509 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8932c28d-797a-4166-be1b-3567f7d9dcf4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:22.236148 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-8932c28d-797a-4166-be1b-3567f7d9dcf4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:22.244204 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-8932c28d-797a-4166-be1b-3567f7d9dcf4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:22.246386 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-8932c28d-797a-4166-be1b-3567f7d9dcf4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:22.247489 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-8932c28d-797a-4166-be1b-3567f7d9dcf4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1407 microversion: 2.20 time: 0.176463 Aug 24 08:00:22.248040 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 284/574] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:22 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:22.347983 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-282f9bc1-47dc-439a-8ab2-94989cf0720b req-79184010-10d7-4444-aefc-7a8e4ea7987b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86d751e5-15c5-4cbb-a9af-711aab6bee68", "name": "network-vif-plugged", "status": "completed", "tag": "f9f1b354-6f60-423b-8ee3-6fff02486c95"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:00:22.357922 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-282f9bc1-47dc-439a-8ab2-94989cf0720b req-79184010-10d7-4444-aefc-7a8e4ea7987b service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:22.358405 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-282f9bc1-47dc-439a-8ab2-94989cf0720b req-79184010-10d7-4444-aefc-7a8e4ea7987b service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:22.358858 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-282f9bc1-47dc-439a-8ab2-94989cf0720b req-79184010-10d7-4444-aefc-7a8e4ea7987b service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:22.369729 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-282f9bc1-47dc-439a-8ab2-94989cf0720b req-79184010-10d7-4444-aefc-7a8e4ea7987b service nova] Creating event network-vif-plugged:f9f1b354-6f60-423b-8ee3-6fff02486c95 for instance 86d751e5-15c5-4cbb-a9af-711aab6bee68 on hv-cinder-85427 Aug 24 08:00:22.375378 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-282f9bc1-47dc-439a-8ab2-94989cf0720b req-79184010-10d7-4444-aefc-7a8e4ea7987b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031147 Aug 24 08:00:22.375956 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 291/575] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:00:23.038909 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-6f7ea3cc-de10-4877-b738-b1231b5d9168 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:23.039543 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-6f7ea3cc-de10-4877-b738-b1231b5d9168 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:23.046057 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6f7ea3cc-de10-4877-b738-b1231b5d9168 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:23.046541 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6f7ea3cc-de10-4877-b738-b1231b5d9168 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:23.046980 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6f7ea3cc-de10-4877-b738-b1231b5d9168 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:23.047676 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6f7ea3cc-de10-4877-b738-b1231b5d9168 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:23.048131 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6f7ea3cc-de10-4877-b738-b1231b5d9168 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:23.048556 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6f7ea3cc-de10-4877-b738-b1231b5d9168 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:23.180238 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-6f7ea3cc-de10-4877-b738-b1231b5d9168 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:23.188492 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-6f7ea3cc-de10-4877-b738-b1231b5d9168 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1359 microversion: 2.1 time: 0.153409 Aug 24 08:00:23.189105 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 285/576] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:23 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:23.274403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-a9fda331-bb10-4e83-9b13-8fa39519d259 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:23.275227 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-a9fda331-bb10-4e83-9b13-8fa39519d259 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:23.279587 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-69e4e7b8-2779-4053-89f4-5020c87a105d tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:23.280167 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-69e4e7b8-2779-4053-89f4-5020c87a105d tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:23.281954 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a9fda331-bb10-4e83-9b13-8fa39519d259 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:23.282728 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a9fda331-bb10-4e83-9b13-8fa39519d259 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:23.283172 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a9fda331-bb10-4e83-9b13-8fa39519d259 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:23.283866 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a9fda331-bb10-4e83-9b13-8fa39519d259 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:23.284341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a9fda331-bb10-4e83-9b13-8fa39519d259 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:23.284804 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a9fda331-bb10-4e83-9b13-8fa39519d259 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:23.286659 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-69e4e7b8-2779-4053-89f4-5020c87a105d tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:23.287216 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-69e4e7b8-2779-4053-89f4-5020c87a105d tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:23.287742 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-69e4e7b8-2779-4053-89f4-5020c87a105d tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:23.288504 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-69e4e7b8-2779-4053-89f4-5020c87a105d tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:23.288993 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-69e4e7b8-2779-4053-89f4-5020c87a105d tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:23.289436 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-69e4e7b8-2779-4053-89f4-5020c87a105d tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:23.319984 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-69e4e7b8-2779-4053-89f4-5020c87a105d tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Going to try to terminate instance {{(pid=127589) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:00:23.424552 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-a9fda331-bb10-4e83-9b13-8fa39519d259 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:23.433064 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-a9fda331-bb10-4e83-9b13-8fa39519d259 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:23.435373 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-a9fda331-bb10-4e83-9b13-8fa39519d259 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:23.436485 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-a9fda331-bb10-4e83-9b13-8fa39519d259 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1407 microversion: 2.20 time: 0.167028 Aug 24 08:00:23.437077 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 292/577] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:23 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:23.707191 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-69e4e7b8-2779-4053-89f4-5020c87a105d tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 204 len: 0 microversion: 2.1 time: 0.431790 Aug 24 08:00:23.707712 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 286/578] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 24 08:00:23 2022] DELETE /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 08:00:23.716514 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-f1a7a08b-e489-44cb-9c67-4afb3fbff2aa tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:23.717154 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-f1a7a08b-e489-44cb-9c67-4afb3fbff2aa tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:23.723252 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f1a7a08b-e489-44cb-9c67-4afb3fbff2aa tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:23.723960 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f1a7a08b-e489-44cb-9c67-4afb3fbff2aa tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:23.724149 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f1a7a08b-e489-44cb-9c67-4afb3fbff2aa tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:23.724868 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f1a7a08b-e489-44cb-9c67-4afb3fbff2aa tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:23.725315 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f1a7a08b-e489-44cb-9c67-4afb3fbff2aa tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:23.725748 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f1a7a08b-e489-44cb-9c67-4afb3fbff2aa tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:23.859194 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-f1a7a08b-e489-44cb-9c67-4afb3fbff2aa tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:23.867123 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-f1a7a08b-e489-44cb-9c67-4afb3fbff2aa tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1513 microversion: 2.1 time: 0.155138 Aug 24 08:00:23.867714 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 293/579] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:23 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:24.210406 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-9bc84656-5abd-44af-b025-079f78d41248 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:24.211103 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-9bc84656-5abd-44af-b025-079f78d41248 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:24.218299 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9bc84656-5abd-44af-b025-079f78d41248 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:24.218863 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9bc84656-5abd-44af-b025-079f78d41248 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:24.219517 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9bc84656-5abd-44af-b025-079f78d41248 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:24.220216 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9bc84656-5abd-44af-b025-079f78d41248 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:24.220706 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9bc84656-5abd-44af-b025-079f78d41248 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:24.221154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9bc84656-5abd-44af-b025-079f78d41248 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:24.358842 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-9bc84656-5abd-44af-b025-079f78d41248 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:24.361369 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:24.367802 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-9bc84656-5abd-44af-b025-079f78d41248 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1359 microversion: 2.1 time: 0.161603 Aug 24 08:00:24.368392 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 287/580] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:24 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:24.459348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-1e78b684-fd6c-46c5-a2c1-fd6eb9c9632e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:24.459946 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-1e78b684-fd6c-46c5-a2c1-fd6eb9c9632e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:24.466315 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1e78b684-fd6c-46c5-a2c1-fd6eb9c9632e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:24.466790 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1e78b684-fd6c-46c5-a2c1-fd6eb9c9632e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:24.467221 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1e78b684-fd6c-46c5-a2c1-fd6eb9c9632e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:24.467903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1e78b684-fd6c-46c5-a2c1-fd6eb9c9632e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:24.468346 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1e78b684-fd6c-46c5-a2c1-fd6eb9c9632e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:24.468791 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1e78b684-fd6c-46c5-a2c1-fd6eb9c9632e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:24.603540 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-1e78b684-fd6c-46c5-a2c1-fd6eb9c9632e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:24.609554 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-1e78b684-fd6c-46c5-a2c1-fd6eb9c9632e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:24.611140 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-1e78b684-fd6c-46c5-a2c1-fd6eb9c9632e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:24.612221 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-1e78b684-fd6c-46c5-a2c1-fd6eb9c9632e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1407 microversion: 2.20 time: 0.156775 Aug 24 08:00:24.612797 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 294/581] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:24 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:24.889017 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-ad0bedbc-2bc7-40a0-8d48-c9bec8f2c6e0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:24.889629 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-ad0bedbc-2bc7-40a0-8d48-c9bec8f2c6e0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:24.895931 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ad0bedbc-2bc7-40a0-8d48-c9bec8f2c6e0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:24.896417 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ad0bedbc-2bc7-40a0-8d48-c9bec8f2c6e0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:24.896885 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ad0bedbc-2bc7-40a0-8d48-c9bec8f2c6e0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:24.897587 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ad0bedbc-2bc7-40a0-8d48-c9bec8f2c6e0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:24.898050 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ad0bedbc-2bc7-40a0-8d48-c9bec8f2c6e0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:24.898476 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ad0bedbc-2bc7-40a0-8d48-c9bec8f2c6e0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:25.030856 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-ad0bedbc-2bc7-40a0-8d48-c9bec8f2c6e0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:25.038713 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-ad0bedbc-2bc7-40a0-8d48-c9bec8f2c6e0 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1513 microversion: 2.1 time: 0.153930 Aug 24 08:00:25.039271 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 288/582] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:24 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:25.389292 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-70ecd4f2-601d-4e7d-9442-0b31c3d56857 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:25.389905 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-70ecd4f2-601d-4e7d-9442-0b31c3d56857 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:25.395833 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-70ecd4f2-601d-4e7d-9442-0b31c3d56857 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:25.396312 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-70ecd4f2-601d-4e7d-9442-0b31c3d56857 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:25.396775 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-70ecd4f2-601d-4e7d-9442-0b31c3d56857 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:25.397471 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-70ecd4f2-601d-4e7d-9442-0b31c3d56857 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:25.397919 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-70ecd4f2-601d-4e7d-9442-0b31c3d56857 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:25.398345 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-70ecd4f2-601d-4e7d-9442-0b31c3d56857 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:25.531222 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-70ecd4f2-601d-4e7d-9442-0b31c3d56857 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:25.539151 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-70ecd4f2-601d-4e7d-9442-0b31c3d56857 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1359 microversion: 2.1 time: 0.153658 Aug 24 08:00:25.541243 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 295/583] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:25 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:25.634766 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-a182687a-8e8f-49f7-80fa-bf99b7c35a60 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:25.635377 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-a182687a-8e8f-49f7-80fa-bf99b7c35a60 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:25.642624 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a182687a-8e8f-49f7-80fa-bf99b7c35a60 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:25.643045 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a182687a-8e8f-49f7-80fa-bf99b7c35a60 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:25.643480 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a182687a-8e8f-49f7-80fa-bf99b7c35a60 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:25.644177 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a182687a-8e8f-49f7-80fa-bf99b7c35a60 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:25.644708 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a182687a-8e8f-49f7-80fa-bf99b7c35a60 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:25.645142 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a182687a-8e8f-49f7-80fa-bf99b7c35a60 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:25.773374 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a182687a-8e8f-49f7-80fa-bf99b7c35a60 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:25.781443 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a182687a-8e8f-49f7-80fa-bf99b7c35a60 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:25.783214 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a182687a-8e8f-49f7-80fa-bf99b7c35a60 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:25.784307 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-a182687a-8e8f-49f7-80fa-bf99b7c35a60 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1407 microversion: 2.20 time: 0.153507 Aug 24 08:00:25.784900 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 289/584] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:25 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:26.059461 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-b74ec242-7c42-4d84-bf6a-0a3f987b4e73 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:26.060072 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-b74ec242-7c42-4d84-bf6a-0a3f987b4e73 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:26.066688 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b74ec242-7c42-4d84-bf6a-0a3f987b4e73 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:26.067167 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b74ec242-7c42-4d84-bf6a-0a3f987b4e73 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:26.067603 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b74ec242-7c42-4d84-bf6a-0a3f987b4e73 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:26.068289 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b74ec242-7c42-4d84-bf6a-0a3f987b4e73 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:26.068765 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b74ec242-7c42-4d84-bf6a-0a3f987b4e73 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:26.069194 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b74ec242-7c42-4d84-bf6a-0a3f987b4e73 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:26.387111 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-8ff1eb5a-fd89-44cf-9344-4856ab985047 req-cc87e73f-3439-40dc-91cd-a912a4df359d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "771d249a-e50d-4848-b6ab-cb76685964d7", "name": "network-vif-plugged", "status": "completed", "tag": "f4073395-cdc8-42de-89a0-3e684efbce28"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:00:26.397985 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-8ff1eb5a-fd89-44cf-9344-4856ab985047 req-cc87e73f-3439-40dc-91cd-a912a4df359d service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:26.398458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-8ff1eb5a-fd89-44cf-9344-4856ab985047 req-cc87e73f-3439-40dc-91cd-a912a4df359d service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:26.398881 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-8ff1eb5a-fd89-44cf-9344-4856ab985047 req-cc87e73f-3439-40dc-91cd-a912a4df359d service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:26.408368 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-b74ec242-7c42-4d84-bf6a-0a3f987b4e73 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:26.414362 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-8ff1eb5a-fd89-44cf-9344-4856ab985047 req-cc87e73f-3439-40dc-91cd-a912a4df359d service nova] Creating event network-vif-plugged:f4073395-cdc8-42de-89a0-3e684efbce28 for instance 771d249a-e50d-4848-b6ab-cb76685964d7 on hv-cinder-85427 Aug 24 08:00:26.417356 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-b74ec242-7c42-4d84-bf6a-0a3f987b4e73 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1513 microversion: 2.1 time: 0.361800 Aug 24 08:00:26.418555 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 296/585] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:26 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1513 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:26.419471 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-8ff1eb5a-fd89-44cf-9344-4856ab985047 req-cc87e73f-3439-40dc-91cd-a912a4df359d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036338 Aug 24 08:00:26.420864 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 290/586] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:00:26.560087 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-bc2f06f8-b4b2-4623-90e3-4cec19444396 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:26.563651 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-bc2f06f8-b4b2-4623-90e3-4cec19444396 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:26.567486 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bc2f06f8-b4b2-4623-90e3-4cec19444396 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:26.567976 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bc2f06f8-b4b2-4623-90e3-4cec19444396 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:26.568412 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bc2f06f8-b4b2-4623-90e3-4cec19444396 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:26.569347 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bc2f06f8-b4b2-4623-90e3-4cec19444396 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:26.569804 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bc2f06f8-b4b2-4623-90e3-4cec19444396 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:26.570445 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bc2f06f8-b4b2-4623-90e3-4cec19444396 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:26.765888 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-bc2f06f8-b4b2-4623-90e3-4cec19444396 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:26.773729 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-bc2f06f8-b4b2-4623-90e3-4cec19444396 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1549 microversion: 2.1 time: 0.217501 Aug 24 08:00:26.774296 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 297/587] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:26 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1549 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:26.800979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-fba7289e-d410-4b32-b62d-e841c8d0cb2d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:26.801765 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-fba7289e-d410-4b32-b62d-e841c8d0cb2d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:26.806866 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-c47d41a0-0169-46a5-8f02-a4e661813e92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:26.807478 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-c47d41a0-0169-46a5-8f02-a4e661813e92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:26.808068 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fba7289e-d410-4b32-b62d-e841c8d0cb2d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:26.808556 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fba7289e-d410-4b32-b62d-e841c8d0cb2d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:26.809030 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fba7289e-d410-4b32-b62d-e841c8d0cb2d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:26.809727 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fba7289e-d410-4b32-b62d-e841c8d0cb2d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:26.810712 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fba7289e-d410-4b32-b62d-e841c8d0cb2d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:26.811561 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fba7289e-d410-4b32-b62d-e841c8d0cb2d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:26.813933 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c47d41a0-0169-46a5-8f02-a4e661813e92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:26.814419 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c47d41a0-0169-46a5-8f02-a4e661813e92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:26.814859 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c47d41a0-0169-46a5-8f02-a4e661813e92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:26.815554 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c47d41a0-0169-46a5-8f02-a4e661813e92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:26.816041 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c47d41a0-0169-46a5-8f02-a4e661813e92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:26.816467 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c47d41a0-0169-46a5-8f02-a4e661813e92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:26.949369 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-fba7289e-d410-4b32-b62d-e841c8d0cb2d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:26.958577 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-fba7289e-d410-4b32-b62d-e841c8d0cb2d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1549 microversion: 2.1 time: 0.162352 Aug 24 08:00:26.959165 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 291/588] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:26 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:26.967916 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-5df602a5-bc89-4ca3-aa29-3b79fd8e767f req-3ef606c7-1f4c-443c-a9c2-a37cb9883a7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c96a75be-6264-4548-aa5d-a893ca4ef99e", "name": "network-vif-deleted", "tag": "2c78af22-1fab-4824-9791-0cc1b1431dc3"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:00:26.977423 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-5df602a5-bc89-4ca3-aa29-3b79fd8e767f req-3ef606c7-1f4c-443c-a9c2-a37cb9883a7a service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:26.977900 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-5df602a5-bc89-4ca3-aa29-3b79fd8e767f req-3ef606c7-1f4c-443c-a9c2-a37cb9883a7a service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:26.978329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-5df602a5-bc89-4ca3-aa29-3b79fd8e767f req-3ef606c7-1f4c-443c-a9c2-a37cb9883a7a service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:26.991166 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-5df602a5-bc89-4ca3-aa29-3b79fd8e767f req-3ef606c7-1f4c-443c-a9c2-a37cb9883a7a service nova] Creating event network-vif-deleted:2c78af22-1fab-4824-9791-0cc1b1431dc3 for instance c96a75be-6264-4548-aa5d-a893ca4ef99e on hv-cinder-85427 Aug 24 08:00:26.998978 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-5df602a5-bc89-4ca3-aa29-3b79fd8e767f req-3ef606c7-1f4c-443c-a9c2-a37cb9883a7a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033692 Aug 24 08:00:26.999844 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 292/589] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:00:27.007623 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-510866a2-191b-4eb3-9d0e-a72733c42b78 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:27.015968 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-510866a2-191b-4eb3-9d0e-a72733c42b78 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:27.017315 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-510866a2-191b-4eb3-9d0e-a72733c42b78 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Searching by: {'deleted': False, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2'} {{(pid=127589) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 08:00:27.025344 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-510866a2-191b-4eb3-9d0e-a72733c42b78 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:27.025837 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-510866a2-191b-4eb3-9d0e-a72733c42b78 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:27.026164 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-c47d41a0-0169-46a5-8f02-a4e661813e92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:27.026386 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-510866a2-191b-4eb3-9d0e-a72733c42b78 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:27.026999 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-510866a2-191b-4eb3-9d0e-a72733c42b78 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:27.027469 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-510866a2-191b-4eb3-9d0e-a72733c42b78 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:27.027896 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-510866a2-191b-4eb3-9d0e-a72733c42b78 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:27.038392 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-c47d41a0-0169-46a5-8f02-a4e661813e92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:27.045495 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-c47d41a0-0169-46a5-8f02-a4e661813e92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:27.045495 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-c47d41a0-0169-46a5-8f02-a4e661813e92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1407 microversion: 2.20 time: 0.238054 Aug 24 08:00:27.045495 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 298/590] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:26 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:00:27.130265 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.multi_cell_list [None req-510866a2-191b-4eb3-9d0e-a72733c42b78 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127589) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 08:00:27.228381 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-510866a2-191b-4eb3-9d0e-a72733c42b78 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.226865 Aug 24 08:00:27.229085 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 293/591] 10.222.0.72 () {58 vars in 1125 bytes} [Wed Aug 24 08:00:26 2022] GET /compute/v2.1/servers => generated 343 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:00:27.239923 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-1618cf7f-1019-4361-b8ff-71c734b65516 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:27.240537 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-1618cf7f-1019-4361-b8ff-71c734b65516 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:27.246475 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1618cf7f-1019-4361-b8ff-71c734b65516 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:27.246962 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1618cf7f-1019-4361-b8ff-71c734b65516 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:27.247395 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1618cf7f-1019-4361-b8ff-71c734b65516 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:27.248119 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1618cf7f-1019-4361-b8ff-71c734b65516 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:27.248574 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1618cf7f-1019-4361-b8ff-71c734b65516 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:27.249032 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1618cf7f-1019-4361-b8ff-71c734b65516 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:27.382192 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-1618cf7f-1019-4361-b8ff-71c734b65516 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:27.390692 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-1618cf7f-1019-4361-b8ff-71c734b65516 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1549 microversion: 2.1 time: 0.154504 Aug 24 08:00:27.391343 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 299/592] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:27 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:27.440002 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-fd424964-7f76-4892-a9ba-9c0ad13b45f6 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:27.440727 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-fd424964-7f76-4892-a9ba-9c0ad13b45f6 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:27.446748 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fd424964-7f76-4892-a9ba-9c0ad13b45f6 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:27.447240 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fd424964-7f76-4892-a9ba-9c0ad13b45f6 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:27.447683 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fd424964-7f76-4892-a9ba-9c0ad13b45f6 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:27.448378 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fd424964-7f76-4892-a9ba-9c0ad13b45f6 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:27.448864 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fd424964-7f76-4892-a9ba-9c0ad13b45f6 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:27.449391 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fd424964-7f76-4892-a9ba-9c0ad13b45f6 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:27.485111 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fd424964-7f76-4892-a9ba-9c0ad13b45f6 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:27.485726 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fd424964-7f76-4892-a9ba-9c0ad13b45f6 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:27.486168 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fd424964-7f76-4892-a9ba-9c0ad13b45f6 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:27.486614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.objects.instance [None req-fd424964-7f76-4892-a9ba-9c0ad13b45f6 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lazy-loading 'fault' on Instance uuid c96a75be-6264-4548-aa5d-a893ca4ef99e {{(pid=127589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:00:27.584437 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-fd424964-7f76-4892-a9ba-9c0ad13b45f6 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:27.593076 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-fd424964-7f76-4892-a9ba-9c0ad13b45f6 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1309 microversion: 2.1 time: 0.157464 Aug 24 08:00:27.593940 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 294/593] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:27 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1309 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:28.067271 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-5dcfea11-98d6-47ac-b95a-ff4e8494c161 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:28.067871 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-5dcfea11-98d6-47ac-b95a-ff4e8494c161 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:28.074280 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5dcfea11-98d6-47ac-b95a-ff4e8494c161 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:28.074757 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5dcfea11-98d6-47ac-b95a-ff4e8494c161 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:28.075187 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5dcfea11-98d6-47ac-b95a-ff4e8494c161 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:28.076542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5dcfea11-98d6-47ac-b95a-ff4e8494c161 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:28.077019 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5dcfea11-98d6-47ac-b95a-ff4e8494c161 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:28.077440 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5dcfea11-98d6-47ac-b95a-ff4e8494c161 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:28.211027 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-5dcfea11-98d6-47ac-b95a-ff4e8494c161 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:28.221327 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-5dcfea11-98d6-47ac-b95a-ff4e8494c161 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:28.222834 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-5dcfea11-98d6-47ac-b95a-ff4e8494c161 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:28.224676 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-5dcfea11-98d6-47ac-b95a-ff4e8494c161 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1407 microversion: 2.20 time: 0.161148 Aug 24 08:00:28.225236 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 300/594] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:28 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:28.615336 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-7948c7b9-973c-4a38-9fc9-ed58b052a0dd tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:28.616088 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-7948c7b9-973c-4a38-9fc9-ed58b052a0dd tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:28.623325 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7948c7b9-973c-4a38-9fc9-ed58b052a0dd tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:28.623903 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7948c7b9-973c-4a38-9fc9-ed58b052a0dd tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:28.624346 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7948c7b9-973c-4a38-9fc9-ed58b052a0dd tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:28.625073 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7948c7b9-973c-4a38-9fc9-ed58b052a0dd tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:28.625570 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7948c7b9-973c-4a38-9fc9-ed58b052a0dd tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:28.625996 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7948c7b9-973c-4a38-9fc9-ed58b052a0dd tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:28.658456 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7948c7b9-973c-4a38-9fc9-ed58b052a0dd tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:28.658856 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7948c7b9-973c-4a38-9fc9-ed58b052a0dd tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:28.659287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7948c7b9-973c-4a38-9fc9-ed58b052a0dd tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:28.659728 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.objects.instance [None req-7948c7b9-973c-4a38-9fc9-ed58b052a0dd tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lazy-loading 'fault' on Instance uuid c96a75be-6264-4548-aa5d-a893ca4ef99e {{(pid=127589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:00:28.699506 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7948c7b9-973c-4a38-9fc9-ed58b052a0dd tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:28.708130 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-7948c7b9-973c-4a38-9fc9-ed58b052a0dd tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 200 len: 1309 microversion: 2.1 time: 0.097480 Aug 24 08:00:28.708963 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 295/595] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:28 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:29.246143 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-7d3104cd-3e00-440e-823c-502ceaf04ade tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:29.246776 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-7d3104cd-3e00-440e-823c-502ceaf04ade tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:29.253239 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d3104cd-3e00-440e-823c-502ceaf04ade tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:29.253720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d3104cd-3e00-440e-823c-502ceaf04ade tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:29.254152 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d3104cd-3e00-440e-823c-502ceaf04ade tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:29.254840 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d3104cd-3e00-440e-823c-502ceaf04ade tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:29.255285 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d3104cd-3e00-440e-823c-502ceaf04ade tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:29.255706 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d3104cd-3e00-440e-823c-502ceaf04ade tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:29.390579 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-7d3104cd-3e00-440e-823c-502ceaf04ade tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:29.399057 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-7d3104cd-3e00-440e-823c-502ceaf04ade tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:29.400576 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-7d3104cd-3e00-440e-823c-502ceaf04ade tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:29.401763 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-7d3104cd-3e00-440e-823c-502ceaf04ade tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1598 microversion: 2.20 time: 0.159616 Aug 24 08:00:29.402326 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 301/596] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:00:29 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:00:29.425280 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-d13172b9-04ba-4f9e-8687-f8b1e864b9da tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:29.425775 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-d13172b9-04ba-4f9e-8687-f8b1e864b9da tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:29.431700 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d13172b9-04ba-4f9e-8687-f8b1e864b9da tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:29.432237 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d13172b9-04ba-4f9e-8687-f8b1e864b9da tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:29.432696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d13172b9-04ba-4f9e-8687-f8b1e864b9da tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:29.433396 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d13172b9-04ba-4f9e-8687-f8b1e864b9da tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:29.433855 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d13172b9-04ba-4f9e-8687-f8b1e864b9da tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:29.434281 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d13172b9-04ba-4f9e-8687-f8b1e864b9da tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:29.508521 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-37060f75-14ec-4c75-ab71-ffaafcb308cc tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b741d81-fb75-4869-b622-d560b858f602"}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:00:29.510990 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-37060f75-14ec-4c75-ab71-ffaafcb308cc tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:29.512094 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-d13172b9-04ba-4f9e-8687-f8b1e864b9da tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090620 Aug 24 08:00:29.512947 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 296/597] 10.222.0.72 () {60 vars in 1316 bytes} [Wed Aug 24 08:00:29 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:00:29.517968 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-37060f75-14ec-4c75-ab71-ffaafcb308cc tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:29.518471 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-37060f75-14ec-4c75-ab71-ffaafcb308cc tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:29.518900 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-37060f75-14ec-4c75-ab71-ffaafcb308cc tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:29.519588 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-37060f75-14ec-4c75-ab71-ffaafcb308cc tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:29.520142 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-37060f75-14ec-4c75-ab71-ffaafcb308cc tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:29.520561 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-37060f75-14ec-4c75-ab71-ffaafcb308cc tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:29.598590 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=100 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:29.729879 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-ddb3d460-8f2c-4324-94a4-67624c25dd0e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:29.730494 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-ddb3d460-8f2c-4324-94a4-67624c25dd0e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: c96a75be-6264-4548-aa5d-a893ca4ef99e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:29.737367 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ddb3d460-8f2c-4324-94a4-67624c25dd0e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:29.737847 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ddb3d460-8f2c-4324-94a4-67624c25dd0e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:29.738278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ddb3d460-8f2c-4324-94a4-67624c25dd0e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:29.739004 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ddb3d460-8f2c-4324-94a4-67624c25dd0e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:29.739453 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ddb3d460-8f2c-4324-94a4-67624c25dd0e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:29.739868 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ddb3d460-8f2c-4324-94a4-67624c25dd0e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:29.754920 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-ddb3d460-8f2c-4324-94a4-67624c25dd0e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] HTTP exception thrown: Instance c96a75be-6264-4548-aa5d-a893ca4ef99e could not be found. Aug 24 08:00:29.756551 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-ddb3d460-8f2c-4324-94a4-67624c25dd0e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Request method failure captured: Aug 24 08:00:29.756551 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e HTTP/1.1 Aug 24 08:00:29.756551 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 08:00:29.756551 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 08:00:29.756551 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 08:00:29.756551 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 08:00:29.756551 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 08:00:29.756551 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 08:00:29.756551 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 08:00:29.756551 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 08:00:29.756551 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdo-lYGksuV4OitjTy6WnepYpTbdqaR4rMaSwOArfw6HNdxDmvNBP3td3HE9wwgg_bdKYILBPK2vzODlsCJgesxmea0QGVnew7mgsf9lVxzkQeOOrxddDDVFRCFJV29ATwZzAZ9JfujE4NU7OZx9nK93dDkTrzwirXgcQMnvRwHRNj0 Aug 24 08:00:29.756551 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 08:00:29.756551 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 08:00:29.756551 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 08:00:29.756551 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 08:00:29.756551 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 08:00:29.756551 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 08:00:29.756551 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: c534e991899e457c8b41e1dbc12a6670 Aug 24 08:00:29.756551 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-VolumesSnapshotTestJSON-913144663 Aug 24 08:00:29.756551 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 08:00:29.756551 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 08:00:29.758133 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_c534e991899e457c8b41e1dbc12a6670"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/c534e991899e457c8b41e1dbc12a6670"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c534e991899e457c8b41e1dbc12a6670"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c534e991899e457c8b41e1dbc12a6670"}]}] Aug 24 08:00:29.758133 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-VolumesSnapshotTestJSON-913144663 Aug 24 08:00:29.758133 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: c534e991899e457c8b41e1dbc12a6670 Aug 24 08:00:29.758133 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-913144663 Aug 24 08:00:29.758133 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-VolumesSnapshotTestJSON-913144663-project Aug 24 08:00:29.758133 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 08:00:29.758133 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 08:00:29.758133 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 5a8de6b6200840dbb9c4d7a3b728f9c2 Aug 24 08:00:29.758133 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-VolumesSnapshotTestJSON-913144663-project Aug 24 08:00:29.758133 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 08:00:29.758133 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Instance c96a75be-6264-4548-aa5d-a893ca4ef99e could not be found. Aug 24 08:00:29.758133 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': 'c96a75be-6264-4548-aa5d-a893ca4ef99e'} Aug 24 08:00:29.759012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:00:29.759012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:00:29.759012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:00:29.759012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:00:29.759012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:00:29.759012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:00:29.759012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:00:29.759012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:00:29.759012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:00:29.759012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:00:29.759012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c96a75be-6264-4548-aa5d-a893ca4ef99e could not be found. Aug 24 08:00:29.759012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:00:29.759012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:00:29.759012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:00:29.759012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:00:29.759012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:00:29.759012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:00:29.759012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:00:29.759012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:00:29.759012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:00:29.760548 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:00:29.760548 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:00:29.760548 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:00:29.760548 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:00:29.760548 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:00:29.760548 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:00:29.760548 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:00:29.760548 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c96a75be-6264-4548-aa5d-a893ca4ef99e could not be found. Aug 24 08:00:29.760548 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:00:29.760548 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:00:29.760548 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:00:29.760548 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:00:29.760548 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:00:29.760548 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:00:29.760548 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:00:29.760548 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:00:29.760548 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c96a75be-6264-4548-aa5d-a893ca4ef99e could not be found. Aug 24 08:00:29.760548 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:00:29.762599 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-ddb3d460-8f2c-4324-94a4-67624c25dd0e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Returning 404 to user: Instance c96a75be-6264-4548-aa5d-a893ca4ef99e could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:00:29.764097 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-ddb3d460-8f2c-4324-94a4-67624c25dd0e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e" status: 404 len: 111 microversion: 2.1 time: 0.037966 Aug 24 08:00:29.764678 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 297/598] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:29 2022] GET /compute/v2.1/servers/c96a75be-6264-4548-aa5d-a893ca4ef99e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:00:30.283662 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-37060f75-14ec-4c75-ab71-ffaafcb308cc tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "POST /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.775267 Aug 24 08:00:30.283662 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 302/599] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 24 08:00:29 2022] POST /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68/os-volume_attachments => generated 194 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:00:30.780995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-0d8a1c70-71e5-4e25-9739-abc19ae62d8f req-141de1df-cfaa-47a7-8e38-6d1272770143 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "771d249a-e50d-4848-b6ab-cb76685964d7", "tag": "f4073395-cdc8-42de-89a0-3e684efbce28"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:00:30.791043 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-0d8a1c70-71e5-4e25-9739-abc19ae62d8f req-141de1df-cfaa-47a7-8e38-6d1272770143 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:30.791524 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-0d8a1c70-71e5-4e25-9739-abc19ae62d8f req-141de1df-cfaa-47a7-8e38-6d1272770143 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:30.791954 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-0d8a1c70-71e5-4e25-9739-abc19ae62d8f req-141de1df-cfaa-47a7-8e38-6d1272770143 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:30.803554 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-0d8a1c70-71e5-4e25-9739-abc19ae62d8f req-141de1df-cfaa-47a7-8e38-6d1272770143 service nova] Creating event network-changed:f4073395-cdc8-42de-89a0-3e684efbce28 for instance 771d249a-e50d-4848-b6ab-cb76685964d7 on hv-cinder-85427 Aug 24 08:00:30.808417 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-0d8a1c70-71e5-4e25-9739-abc19ae62d8f req-141de1df-cfaa-47a7-8e38-6d1272770143 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031577 Aug 24 08:00:30.809088 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 298/600] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:00:40.265230 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=39 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:40.266072 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=6,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:40.270201 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-38c476fc-7979-4e6a-a929-678a7701621f tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-556281579", "imageRef": "ccdab334-55ce-4ff5-bd97-5a424660c282", "flavorRef": "452", "networks": [{"uuid": "a3255728-56b0-475b-8190-6ecfc66d7231"}]}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:00:40.323738 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.network.neutron [None req-38c476fc-7979-4e6a-a929-678a7701621f tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] validate_networks() for [('a3255728-56b0-475b-8190-6ecfc66d7231', None, None, None, None, None)] {{(pid=127590) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:00:40.772908 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-38c476fc-7979-4e6a-a929-678a7701621f tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Flavor limits 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:00:40.772908 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-38c476fc-7979-4e6a-a929-678a7701621f tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Image limits 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:00:40.772908 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-38c476fc-7979-4e6a-a929-678a7701621f tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Flavor pref 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:00:40.772908 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-38c476fc-7979-4e6a-a929-678a7701621f tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Image pref 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:00:40.772908 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-38c476fc-7979-4e6a-a929-678a7701621f tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:00:40.773925 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-38c476fc-7979-4e6a-a929-678a7701621f tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:40.773925 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-38c476fc-7979-4e6a-a929-678a7701621f tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:40.773925 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-38c476fc-7979-4e6a-a929-678a7701621f tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:40.773925 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-38c476fc-7979-4e6a-a929-678a7701621f tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:40.774227 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-38c476fc-7979-4e6a-a929-678a7701621f tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:40.774227 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-38c476fc-7979-4e6a-a929-678a7701621f tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:40.774227 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-38c476fc-7979-4e6a-a929-678a7701621f tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Getting quotas for project c534e991899e457c8b41e1dbc12a6670. Resources: {'cores', 'instances', 'ram'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:00:40.774227 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-38c476fc-7979-4e6a-a929-678a7701621f tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Getting quotas for user 5a8de6b6200840dbb9c4d7a3b728f9c2 and project c534e991899e457c8b41e1dbc12a6670. Resources: {'cores', 'instances', 'ram'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:00:40.774524 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-38c476fc-7979-4e6a-a929-678a7701621f tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Going to run 1 instances... {{(pid=127590) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:00:40.774524 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-38c476fc-7979-4e6a-a929-678a7701621f tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccdab334-55ce-4ff5-bd97-5a424660c282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:00:41.271945 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-38c476fc-7979-4e6a-a929-678a7701621f tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.008313 Aug 24 08:00:41.276016 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 303/601] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 24 08:00:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 08:00:41.282082 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=2 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:41.283310 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:41.283948 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=55 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:41.288910 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-bcf7ca91-eb3b-413c-9a28-5cd36d4f1f68 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:41.289960 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-bcf7ca91-eb3b-413c-9a28-5cd36d4f1f68 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:41.345979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-bcf7ca91-eb3b-413c-9a28-5cd36d4f1f68 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:41.353132 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-bcf7ca91-eb3b-413c-9a28-5cd36d4f1f68 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a" status: 200 len: 1218 microversion: 2.1 time: 0.073351 Aug 24 08:00:41.353698 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 299/602] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:41 2022] GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:42.119367 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-ec1c5460-fdd8-4d0b-adc0-6c6da173c9de tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:42.119982 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-ec1c5460-fdd8-4d0b-adc0-6c6da173c9de tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:42.127378 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ec1c5460-fdd8-4d0b-adc0-6c6da173c9de tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:42.129573 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ec1c5460-fdd8-4d0b-adc0-6c6da173c9de tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:42.129573 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ec1c5460-fdd8-4d0b-adc0-6c6da173c9de tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:42.129573 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ec1c5460-fdd8-4d0b-adc0-6c6da173c9de tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:42.129573 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ec1c5460-fdd8-4d0b-adc0-6c6da173c9de tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:42.130586 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ec1c5460-fdd8-4d0b-adc0-6c6da173c9de tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:42.352998 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-ec1c5460-fdd8-4d0b-adc0-6c6da173c9de tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:42.362671 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-ec1c5460-fdd8-4d0b-adc0-6c6da173c9de tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1595 microversion: 2.1 time: 0.247146 Aug 24 08:00:42.373073 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 304/603] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:42 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1595 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:42.380806 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-0e8339c2-9f9b-47bb-87cc-c5878fbb5d87 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:42.382116 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-0e8339c2-9f9b-47bb-87cc-c5878fbb5d87 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:42.390325 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0e8339c2-9f9b-47bb-87cc-c5878fbb5d87 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:42.391318 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0e8339c2-9f9b-47bb-87cc-c5878fbb5d87 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:42.391763 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0e8339c2-9f9b-47bb-87cc-c5878fbb5d87 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:42.392704 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0e8339c2-9f9b-47bb-87cc-c5878fbb5d87 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:42.393161 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0e8339c2-9f9b-47bb-87cc-c5878fbb5d87 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:42.393811 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0e8339c2-9f9b-47bb-87cc-c5878fbb5d87 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:42.462051 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-0e8339c2-9f9b-47bb-87cc-c5878fbb5d87 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:42.469892 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-0e8339c2-9f9b-47bb-87cc-c5878fbb5d87 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a" status: 200 len: 1214 microversion: 2.1 time: 0.094814 Aug 24 08:00:42.470460 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 300/604] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:42 2022] GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:00:43.491528 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-271539d8-a90e-4466-a48e-6dc22fa684ee tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:43.492699 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-271539d8-a90e-4466-a48e-6dc22fa684ee tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:43.499967 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-271539d8-a90e-4466-a48e-6dc22fa684ee tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:43.500447 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-271539d8-a90e-4466-a48e-6dc22fa684ee tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:43.500920 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-271539d8-a90e-4466-a48e-6dc22fa684ee tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:43.501673 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-271539d8-a90e-4466-a48e-6dc22fa684ee tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:43.502129 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-271539d8-a90e-4466-a48e-6dc22fa684ee tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:43.502707 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-271539d8-a90e-4466-a48e-6dc22fa684ee tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:43.573894 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-271539d8-a90e-4466-a48e-6dc22fa684ee tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:43.582602 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-271539d8-a90e-4466-a48e-6dc22fa684ee tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a" status: 200 len: 1288 microversion: 2.1 time: 0.095107 Aug 24 08:00:43.594149 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 305/605] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:43 2022] GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a => generated 1288 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:44.445567 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-2024c0f4-937c-440c-bf26-566b82834da9 req-386f7e79-273b-49f2-8b8b-401529f7ab1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86d751e5-15c5-4cbb-a9af-711aab6bee68", "tag": "f9f1b354-6f60-423b-8ee3-6fff02486c95"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:00:44.455964 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-2024c0f4-937c-440c-bf26-566b82834da9 req-386f7e79-273b-49f2-8b8b-401529f7ab1d service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:44.456740 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-2024c0f4-937c-440c-bf26-566b82834da9 req-386f7e79-273b-49f2-8b8b-401529f7ab1d service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:44.457176 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-2024c0f4-937c-440c-bf26-566b82834da9 req-386f7e79-273b-49f2-8b8b-401529f7ab1d service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:44.473545 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-2024c0f4-937c-440c-bf26-566b82834da9 req-386f7e79-273b-49f2-8b8b-401529f7ab1d service nova] Creating event network-changed:f9f1b354-6f60-423b-8ee3-6fff02486c95 for instance 86d751e5-15c5-4cbb-a9af-711aab6bee68 on hv-cinder-85427 Aug 24 08:00:44.483573 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-2024c0f4-937c-440c-bf26-566b82834da9 req-386f7e79-273b-49f2-8b8b-401529f7ab1d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041127 Aug 24 08:00:44.484926 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 301/606] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:00:44.605124 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-80d246b8-711b-4cfd-8c23-b8792f8c1527 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:44.606893 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-80d246b8-711b-4cfd-8c23-b8792f8c1527 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:44.615855 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-80d246b8-711b-4cfd-8c23-b8792f8c1527 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:44.616744 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-80d246b8-711b-4cfd-8c23-b8792f8c1527 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:44.617411 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-80d246b8-711b-4cfd-8c23-b8792f8c1527 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:44.618510 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-80d246b8-711b-4cfd-8c23-b8792f8c1527 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:44.619175 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-80d246b8-711b-4cfd-8c23-b8792f8c1527 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:44.619955 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-80d246b8-711b-4cfd-8c23-b8792f8c1527 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:44.894232 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-80d246b8-711b-4cfd-8c23-b8792f8c1527 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:44.911208 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-80d246b8-711b-4cfd-8c23-b8792f8c1527 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a" status: 200 len: 1318 microversion: 2.1 time: 0.311478 Aug 24 08:00:44.917472 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 306/607] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:44 2022] GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:45.121797 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-5439d909-378e-4823-a603-f7428e57e142 req-486a18e0-fd59-4adb-95bf-05680a2c0648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "584a6731-7b9d-4ffb-aacd-14d40a3bdc4a", "tag": "596000da-fcc8-40ef-a757-9986f310fce4"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:00:45.153692 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-5439d909-378e-4823-a603-f7428e57e142 req-486a18e0-fd59-4adb-95bf-05680a2c0648 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:45.153692 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-5439d909-378e-4823-a603-f7428e57e142 req-486a18e0-fd59-4adb-95bf-05680a2c0648 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:45.153692 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-5439d909-378e-4823-a603-f7428e57e142 req-486a18e0-fd59-4adb-95bf-05680a2c0648 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:45.192851 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-5439d909-378e-4823-a603-f7428e57e142 req-486a18e0-fd59-4adb-95bf-05680a2c0648 service nova] Creating event network-changed:596000da-fcc8-40ef-a757-9986f310fce4 for instance 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a on hv-cinder-85427 Aug 24 08:00:45.197910 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-5439d909-378e-4823-a603-f7428e57e142 req-486a18e0-fd59-4adb-95bf-05680a2c0648 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085274 Aug 24 08:00:45.199040 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 302/608] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:00:45.933357 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-a55d8a81-8566-48f8-9c10-22332654b1e1 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:45.933996 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-a55d8a81-8566-48f8-9c10-22332654b1e1 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:45.941348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a55d8a81-8566-48f8-9c10-22332654b1e1 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:45.941865 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a55d8a81-8566-48f8-9c10-22332654b1e1 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:45.942273 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a55d8a81-8566-48f8-9c10-22332654b1e1 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:45.942985 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a55d8a81-8566-48f8-9c10-22332654b1e1 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:45.943437 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a55d8a81-8566-48f8-9c10-22332654b1e1 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:45.943865 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a55d8a81-8566-48f8-9c10-22332654b1e1 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:46.324947 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-a55d8a81-8566-48f8-9c10-22332654b1e1 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:46.333179 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-a55d8a81-8566-48f8-9c10-22332654b1e1 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a" status: 200 len: 1318 microversion: 2.1 time: 0.403997 Aug 24 08:00:46.333747 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 307/609] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:45 2022] GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:47.355298 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-724fe505-516a-46e4-bdae-13c32fceb667 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:47.356006 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-724fe505-516a-46e4-bdae-13c32fceb667 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:47.362786 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-724fe505-516a-46e4-bdae-13c32fceb667 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:47.366565 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-724fe505-516a-46e4-bdae-13c32fceb667 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:47.366565 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-724fe505-516a-46e4-bdae-13c32fceb667 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:47.366565 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-724fe505-516a-46e4-bdae-13c32fceb667 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:47.366565 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-724fe505-516a-46e4-bdae-13c32fceb667 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:47.367061 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-724fe505-516a-46e4-bdae-13c32fceb667 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:47.508876 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-724fe505-516a-46e4-bdae-13c32fceb667 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:47.517329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-724fe505-516a-46e4-bdae-13c32fceb667 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a" status: 200 len: 1318 microversion: 2.1 time: 0.166741 Aug 24 08:00:47.517935 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 303/610] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:47 2022] GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:47.548075 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-d3138146-921f-4c58-b755-44963357f210 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-988986265"}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:00:47.548629 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-d3138146-921f-4c58-b755-44963357f210 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:47.555084 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d3138146-921f-4c58-b755-44963357f210 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:47.555513 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d3138146-921f-4c58-b755-44963357f210 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:47.555949 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d3138146-921f-4c58-b755-44963357f210 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:47.556643 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d3138146-921f-4c58-b755-44963357f210 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:47.557128 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d3138146-921f-4c58-b755-44963357f210 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:47.557553 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d3138146-921f-4c58-b755-44963357f210 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:47.680499 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.network.security_group_api [None req-d3138146-921f-4c58-b755-44963357f210 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Adding security group 7082845b-6c67-4ad1-8150-cce2528ae451 to port f9f1b354-6f60-423b-8ee3-6fff02486c95 Aug 24 08:00:48.054375 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-d3138146-921f-4c58-b755-44963357f210 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "POST /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68/action" status: 202 len: 0 microversion: 2.1 time: 0.510122 Aug 24 08:00:48.055689 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 308/611] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 24 08:00:47 2022] POST /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:00:48.064468 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-78c02c7e-2dea-465a-aa40-8d646bb8e8fa tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:48.065238 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-78c02c7e-2dea-465a-aa40-8d646bb8e8fa tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:48.070141 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-afa3a155-8fe1-486b-97b0-6ae6d101a11b req-1049badd-abfd-4672-b12f-df8e3b9496cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86d751e5-15c5-4cbb-a9af-711aab6bee68", "tag": "f9f1b354-6f60-423b-8ee3-6fff02486c95"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:00:48.071147 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-78c02c7e-2dea-465a-aa40-8d646bb8e8fa tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:48.071824 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-78c02c7e-2dea-465a-aa40-8d646bb8e8fa tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:48.072409 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-78c02c7e-2dea-465a-aa40-8d646bb8e8fa tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:48.073296 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-78c02c7e-2dea-465a-aa40-8d646bb8e8fa tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:48.074139 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-78c02c7e-2dea-465a-aa40-8d646bb8e8fa tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:48.074562 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-78c02c7e-2dea-465a-aa40-8d646bb8e8fa tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:48.082160 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-afa3a155-8fe1-486b-97b0-6ae6d101a11b req-1049badd-abfd-4672-b12f-df8e3b9496cd service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:48.082662 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-afa3a155-8fe1-486b-97b0-6ae6d101a11b req-1049badd-abfd-4672-b12f-df8e3b9496cd service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:48.083093 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-afa3a155-8fe1-486b-97b0-6ae6d101a11b req-1049badd-abfd-4672-b12f-df8e3b9496cd service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:48.103152 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-afa3a155-8fe1-486b-97b0-6ae6d101a11b req-1049badd-abfd-4672-b12f-df8e3b9496cd service nova] Creating event network-changed:f9f1b354-6f60-423b-8ee3-6fff02486c95 for instance 86d751e5-15c5-4cbb-a9af-711aab6bee68 on hv-cinder-85427 Aug 24 08:00:48.122172 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-afa3a155-8fe1-486b-97b0-6ae6d101a11b req-1049badd-abfd-4672-b12f-df8e3b9496cd service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047189 Aug 24 08:00:48.129348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 309/612] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:00:48.357272 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-78c02c7e-2dea-465a-aa40-8d646bb8e8fa tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:48.366310 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-78c02c7e-2dea-465a-aa40-8d646bb8e8fa tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1760 microversion: 2.1 time: 0.306054 Aug 24 08:00:48.367454 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 304/613] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:48 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1760 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:48.367995 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-7d45825a-b59d-48fe-8aa9-8cb1345db92b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:48.368584 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-7d45825a-b59d-48fe-8aa9-8cb1345db92b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:48.374876 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d45825a-b59d-48fe-8aa9-8cb1345db92b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:48.375587 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d45825a-b59d-48fe-8aa9-8cb1345db92b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:48.376191 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d45825a-b59d-48fe-8aa9-8cb1345db92b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:48.377273 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d45825a-b59d-48fe-8aa9-8cb1345db92b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:48.378395 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d45825a-b59d-48fe-8aa9-8cb1345db92b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:48.378998 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7d45825a-b59d-48fe-8aa9-8cb1345db92b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:48.524197 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.objects.instance [None req-7d45825a-b59d-48fe-8aa9-8cb1345db92b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lazy-loading 'services' on Instance uuid f31397ec-5acf-4a90-a500-280a47ed1f55 {{(pid=127590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:00:48.538842 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-c021baea-c5fb-4f88-828d-2c3ee1674358 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:48.539732 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-c021baea-c5fb-4f88-828d-2c3ee1674358 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:48.546659 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c021baea-c5fb-4f88-828d-2c3ee1674358 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:48.547603 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c021baea-c5fb-4f88-828d-2c3ee1674358 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:48.548209 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c021baea-c5fb-4f88-828d-2c3ee1674358 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:48.549193 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c021baea-c5fb-4f88-828d-2c3ee1674358 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:48.549797 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c021baea-c5fb-4f88-828d-2c3ee1674358 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:48.550369 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c021baea-c5fb-4f88-828d-2c3ee1674358 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:48.794709 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-c021baea-c5fb-4f88-828d-2c3ee1674358 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:48.804075 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-c021baea-c5fb-4f88-828d-2c3ee1674358 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a" status: 200 len: 1318 microversion: 2.1 time: 0.269056 Aug 24 08:00:48.804682 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 305/614] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:48 2022] GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:00:48.852798 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-7d45825a-b59d-48fe-8aa9-8cb1345db92b tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55/os-volume_attachments/4b2a9569-edc5-4595-bfb1-85cf0714c6df" status: 202 len: 0 microversion: 2.1 time: 0.488964 Aug 24 08:00:48.853454 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 310/615] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 24 08:00:48 2022] DELETE /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55/os-volume_attachments/4b2a9569-edc5-4595-bfb1-85cf0714c6df => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 08:00:48.863211 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-823bd5db-8f2c-4ba1-8e7e-310946161819 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:48.865836 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-823bd5db-8f2c-4ba1-8e7e-310946161819 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:48.872830 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-823bd5db-8f2c-4ba1-8e7e-310946161819 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:48.875278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-823bd5db-8f2c-4ba1-8e7e-310946161819 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:48.875747 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-823bd5db-8f2c-4ba1-8e7e-310946161819 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:48.876643 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-823bd5db-8f2c-4ba1-8e7e-310946161819 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:48.877146 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-823bd5db-8f2c-4ba1-8e7e-310946161819 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:48.877582 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-823bd5db-8f2c-4ba1-8e7e-310946161819 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:48.917041 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-823bd5db-8f2c-4ba1-8e7e-310946161819 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058332 Aug 24 08:00:48.917690 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 306/616] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 24 08:00:48 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:00:49.826755 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-4b71fc34-4dba-4e5d-ba33-cf7c515ba5bd tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:49.827483 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-4b71fc34-4dba-4e5d-ba33-cf7c515ba5bd tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:49.833757 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4b71fc34-4dba-4e5d-ba33-cf7c515ba5bd tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:49.834239 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4b71fc34-4dba-4e5d-ba33-cf7c515ba5bd tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:49.834679 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4b71fc34-4dba-4e5d-ba33-cf7c515ba5bd tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:49.835373 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4b71fc34-4dba-4e5d-ba33-cf7c515ba5bd tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:49.835863 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4b71fc34-4dba-4e5d-ba33-cf7c515ba5bd tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:49.836289 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4b71fc34-4dba-4e5d-ba33-cf7c515ba5bd tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:49.932955 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-82b76d49-60ec-40be-8b62-1a1e8238de3c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:49.935102 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-82b76d49-60ec-40be-8b62-1a1e8238de3c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:49.941621 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-82b76d49-60ec-40be-8b62-1a1e8238de3c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:49.945435 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-82b76d49-60ec-40be-8b62-1a1e8238de3c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:49.945435 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-82b76d49-60ec-40be-8b62-1a1e8238de3c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:49.945435 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-82b76d49-60ec-40be-8b62-1a1e8238de3c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:49.945435 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-82b76d49-60ec-40be-8b62-1a1e8238de3c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:49.945832 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-82b76d49-60ec-40be-8b62-1a1e8238de3c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:49.976142 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-82b76d49-60ec-40be-8b62-1a1e8238de3c tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049723 Aug 24 08:00:49.982142 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 307/617] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 24 08:00:49 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 08:00:49.990453 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-4b71fc34-4dba-4e5d-ba33-cf7c515ba5bd tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:49.998224 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-4b71fc34-4dba-4e5d-ba33-cf7c515ba5bd tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a" status: 200 len: 1318 microversion: 2.1 time: 0.176700 Aug 24 08:00:49.998918 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 311/618] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:49 2022] GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:50.059085 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-d6ebe82f-d222-4a3a-b94f-3e997fb75135 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:50.059588 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-d6ebe82f-d222-4a3a-b94f-3e997fb75135 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:50.066106 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d6ebe82f-d222-4a3a-b94f-3e997fb75135 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:50.066591 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d6ebe82f-d222-4a3a-b94f-3e997fb75135 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:50.067033 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d6ebe82f-d222-4a3a-b94f-3e997fb75135 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:50.067729 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d6ebe82f-d222-4a3a-b94f-3e997fb75135 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:50.068189 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d6ebe82f-d222-4a3a-b94f-3e997fb75135 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:50.068623 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d6ebe82f-d222-4a3a-b94f-3e997fb75135 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:50.093882 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-d6ebe82f-d222-4a3a-b94f-3e997fb75135 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Going to try to terminate instance {{(pid=127589) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:00:50.376623 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-d6ebe82f-d222-4a3a-b94f-3e997fb75135 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 204 len: 0 microversion: 2.1 time: 0.320718 Aug 24 08:00:50.377367 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 308/619] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 24 08:00:50 2022] DELETE /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:00:50.386792 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-eec829e3-c458-4bdf-995f-5c31220bc29d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:50.387396 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-eec829e3-c458-4bdf-995f-5c31220bc29d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:50.394192 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-eec829e3-c458-4bdf-995f-5c31220bc29d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:50.394658 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-eec829e3-c458-4bdf-995f-5c31220bc29d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:50.395088 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-eec829e3-c458-4bdf-995f-5c31220bc29d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:50.395774 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-eec829e3-c458-4bdf-995f-5c31220bc29d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:50.396217 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-eec829e3-c458-4bdf-995f-5c31220bc29d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:50.396636 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-eec829e3-c458-4bdf-995f-5c31220bc29d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:50.514451 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-a0e67ada-df9d-41e1-a8db-abbe7593f9e1 req-a6020f87-12ce-41ba-a996-b371ad63dc48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "584a6731-7b9d-4ffb-aacd-14d40a3bdc4a", "name": "network-vif-plugged", "status": "completed", "tag": "596000da-fcc8-40ef-a757-9986f310fce4"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:00:50.524309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-a0e67ada-df9d-41e1-a8db-abbe7593f9e1 req-a6020f87-12ce-41ba-a996-b371ad63dc48 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:50.524846 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-a0e67ada-df9d-41e1-a8db-abbe7593f9e1 req-a6020f87-12ce-41ba-a996-b371ad63dc48 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:50.525277 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-a0e67ada-df9d-41e1-a8db-abbe7593f9e1 req-a6020f87-12ce-41ba-a996-b371ad63dc48 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:50.530695 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-eec829e3-c458-4bdf-995f-5c31220bc29d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:50.536831 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-a0e67ada-df9d-41e1-a8db-abbe7593f9e1 req-a6020f87-12ce-41ba-a996-b371ad63dc48 service nova] Creating event network-vif-plugged:596000da-fcc8-40ef-a757-9986f310fce4 for instance 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a on hv-cinder-85427 Aug 24 08:00:50.539036 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-eec829e3-c458-4bdf-995f-5c31220bc29d tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1686 microversion: 2.1 time: 0.156101 Aug 24 08:00:50.539600 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 312/620] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:50 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:50.546894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-a0e67ada-df9d-41e1-a8db-abbe7593f9e1 req-a6020f87-12ce-41ba-a996-b371ad63dc48 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037154 Aug 24 08:00:50.550118 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 309/621] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:00:51.018627 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-47ef3cab-9cae-4053-8aa8-4444fc8c2d1e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:51.019170 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-47ef3cab-9cae-4053-8aa8-4444fc8c2d1e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:51.021101 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=2 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:51.021924 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=6 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:51.027058 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-47ef3cab-9cae-4053-8aa8-4444fc8c2d1e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:51.027530 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-47ef3cab-9cae-4053-8aa8-4444fc8c2d1e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:51.027960 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-47ef3cab-9cae-4053-8aa8-4444fc8c2d1e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:51.028719 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-47ef3cab-9cae-4053-8aa8-4444fc8c2d1e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:51.029669 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-47ef3cab-9cae-4053-8aa8-4444fc8c2d1e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:51.034343 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-47ef3cab-9cae-4053-8aa8-4444fc8c2d1e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:51.158426 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-47ef3cab-9cae-4053-8aa8-4444fc8c2d1e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:51.166040 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-47ef3cab-9cae-4053-8aa8-4444fc8c2d1e tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a" status: 200 len: 1318 microversion: 2.1 time: 0.151362 Aug 24 08:00:51.166610 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 313/622] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:51 2022] GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:51.561909 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-8b37d968-606c-44c2-803e-de6ae3629334 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:51.562651 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-8b37d968-606c-44c2-803e-de6ae3629334 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:51.565068 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=2 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:51.570170 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8b37d968-606c-44c2-803e-de6ae3629334 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:51.570637 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8b37d968-606c-44c2-803e-de6ae3629334 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:51.571072 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8b37d968-606c-44c2-803e-de6ae3629334 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:51.571765 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8b37d968-606c-44c2-803e-de6ae3629334 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:51.572220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8b37d968-606c-44c2-803e-de6ae3629334 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:51.572662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8b37d968-606c-44c2-803e-de6ae3629334 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:51.705158 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-8b37d968-606c-44c2-803e-de6ae3629334 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:51.712821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-8b37d968-606c-44c2-803e-de6ae3629334 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1686 microversion: 2.1 time: 0.155655 Aug 24 08:00:51.713374 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 310/623] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:51 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:52.187749 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-c82c894a-354e-47be-bbf6-f60bbc63b0c3 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:52.188353 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-c82c894a-354e-47be-bbf6-f60bbc63b0c3 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:52.195026 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c82c894a-354e-47be-bbf6-f60bbc63b0c3 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:52.195517 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c82c894a-354e-47be-bbf6-f60bbc63b0c3 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:52.195958 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c82c894a-354e-47be-bbf6-f60bbc63b0c3 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:52.196680 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c82c894a-354e-47be-bbf6-f60bbc63b0c3 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:52.197139 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c82c894a-354e-47be-bbf6-f60bbc63b0c3 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:52.197564 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c82c894a-354e-47be-bbf6-f60bbc63b0c3 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:52.327292 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-c82c894a-354e-47be-bbf6-f60bbc63b0c3 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:52.334917 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-c82c894a-354e-47be-bbf6-f60bbc63b0c3 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a" status: 200 len: 1318 microversion: 2.1 time: 0.151825 Aug 24 08:00:52.335477 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 314/624] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:52 2022] GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:52.733974 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-cfe9ecaf-d129-40b1-8c9c-fcedb563db79 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:52.734577 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-cfe9ecaf-d129-40b1-8c9c-fcedb563db79 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:52.741036 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cfe9ecaf-d129-40b1-8c9c-fcedb563db79 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:52.741515 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cfe9ecaf-d129-40b1-8c9c-fcedb563db79 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:52.741948 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cfe9ecaf-d129-40b1-8c9c-fcedb563db79 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:52.742631 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cfe9ecaf-d129-40b1-8c9c-fcedb563db79 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:52.743079 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cfe9ecaf-d129-40b1-8c9c-fcedb563db79 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:52.743498 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cfe9ecaf-d129-40b1-8c9c-fcedb563db79 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:52.869747 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-cfe9ecaf-d129-40b1-8c9c-fcedb563db79 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:52.877460 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-cfe9ecaf-d129-40b1-8c9c-fcedb563db79 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1686 microversion: 2.1 time: 0.147492 Aug 24 08:00:52.878022 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 311/625] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:52 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1686 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:53.355326 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-39d0b210-93c7-4bd1-9fd6-3298299c2229 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:53.356079 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-39d0b210-93c7-4bd1-9fd6-3298299c2229 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:53.362437 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-39d0b210-93c7-4bd1-9fd6-3298299c2229 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:53.362908 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-39d0b210-93c7-4bd1-9fd6-3298299c2229 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:53.363338 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-39d0b210-93c7-4bd1-9fd6-3298299c2229 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:53.364022 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-39d0b210-93c7-4bd1-9fd6-3298299c2229 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:53.364464 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-39d0b210-93c7-4bd1-9fd6-3298299c2229 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:53.364906 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-39d0b210-93c7-4bd1-9fd6-3298299c2229 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:53.492115 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-39d0b210-93c7-4bd1-9fd6-3298299c2229 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:53.500344 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-39d0b210-93c7-4bd1-9fd6-3298299c2229 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a" status: 200 len: 1318 microversion: 2.1 time: 0.148821 Aug 24 08:00:53.500944 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 315/626] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:53 2022] GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:00:53.898689 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-31d2f7fc-beb8-41f5-aa06-fb070fab5a05 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:53.899300 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-31d2f7fc-beb8-41f5-aa06-fb070fab5a05 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:53.906288 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-31d2f7fc-beb8-41f5-aa06-fb070fab5a05 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:53.906774 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-31d2f7fc-beb8-41f5-aa06-fb070fab5a05 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:53.907468 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-31d2f7fc-beb8-41f5-aa06-fb070fab5a05 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:53.908195 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-31d2f7fc-beb8-41f5-aa06-fb070fab5a05 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:53.908666 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-31d2f7fc-beb8-41f5-aa06-fb070fab5a05 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:53.909105 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-31d2f7fc-beb8-41f5-aa06-fb070fab5a05 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:54.039343 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-31d2f7fc-beb8-41f5-aa06-fb070fab5a05 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:54.047892 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-31d2f7fc-beb8-41f5-aa06-fb070fab5a05 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1686 microversion: 2.1 time: 0.153090 Aug 24 08:00:54.048462 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 312/627] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:53 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:54.526448 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-955f3fda-a5a2-429e-8dfa-ab010994feb7 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:54.526448 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-955f3fda-a5a2-429e-8dfa-ab010994feb7 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:54.528253 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-955f3fda-a5a2-429e-8dfa-ab010994feb7 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:54.528807 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-955f3fda-a5a2-429e-8dfa-ab010994feb7 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:54.529986 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-955f3fda-a5a2-429e-8dfa-ab010994feb7 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:54.530687 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-955f3fda-a5a2-429e-8dfa-ab010994feb7 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:54.531134 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-955f3fda-a5a2-429e-8dfa-ab010994feb7 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:54.531549 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-955f3fda-a5a2-429e-8dfa-ab010994feb7 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:54.796481 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-955f3fda-a5a2-429e-8dfa-ab010994feb7 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:54.804073 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-955f3fda-a5a2-429e-8dfa-ab010994feb7 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a" status: 200 len: 1318 microversion: 2.1 time: 0.286592 Aug 24 08:00:54.804631 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 316/628] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:54 2022] GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:55.069530 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e22c31c7-f7f5-4b4f-a275-55b0ac6a1c94 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:55.070147 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-e22c31c7-f7f5-4b4f-a275-55b0ac6a1c94 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:55.076566 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e22c31c7-f7f5-4b4f-a275-55b0ac6a1c94 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:55.077079 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e22c31c7-f7f5-4b4f-a275-55b0ac6a1c94 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:55.077515 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e22c31c7-f7f5-4b4f-a275-55b0ac6a1c94 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:55.078199 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e22c31c7-f7f5-4b4f-a275-55b0ac6a1c94 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:55.078650 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e22c31c7-f7f5-4b4f-a275-55b0ac6a1c94 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:55.079070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e22c31c7-f7f5-4b4f-a275-55b0ac6a1c94 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:55.141792 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e22c31c7-f7f5-4b4f-a275-55b0ac6a1c94 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:55.150630 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-e22c31c7-f7f5-4b4f-a275-55b0ac6a1c94 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1619 microversion: 2.1 time: 0.084767 Aug 24 08:00:55.159567 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 313/629] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:55 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1619 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:55.418004 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-5513ab22-cfc2-4ca4-8d0c-5c49653e6e23 req-87176ad9-ca3c-4d86-b3f1-96d87354ff2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31397ec-5acf-4a90-a500-280a47ed1f55", "name": "network-vif-deleted", "tag": "8acdda10-43f7-423f-9513-4deb10644221"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:00:55.428779 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-5513ab22-cfc2-4ca4-8d0c-5c49653e6e23 req-87176ad9-ca3c-4d86-b3f1-96d87354ff2f service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:55.428779 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-5513ab22-cfc2-4ca4-8d0c-5c49653e6e23 req-87176ad9-ca3c-4d86-b3f1-96d87354ff2f service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:55.429140 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-5513ab22-cfc2-4ca4-8d0c-5c49653e6e23 req-87176ad9-ca3c-4d86-b3f1-96d87354ff2f service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:55.440285 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-5513ab22-cfc2-4ca4-8d0c-5c49653e6e23 req-87176ad9-ca3c-4d86-b3f1-96d87354ff2f service nova] Creating event network-vif-deleted:8acdda10-43f7-423f-9513-4deb10644221 for instance f31397ec-5acf-4a90-a500-280a47ed1f55 on hv-cinder-85427 Aug 24 08:00:55.445301 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-5513ab22-cfc2-4ca4-8d0c-5c49653e6e23 req-87176ad9-ca3c-4d86-b3f1-96d87354ff2f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031028 Aug 24 08:00:55.445883 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 317/630] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:00:55.825515 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b852d554-90a7-4599-b6b9-b3ce119b7e33 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:55.826757 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-b852d554-90a7-4599-b6b9-b3ce119b7e33 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:55.833563 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b852d554-90a7-4599-b6b9-b3ce119b7e33 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:55.834057 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b852d554-90a7-4599-b6b9-b3ce119b7e33 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:55.834497 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b852d554-90a7-4599-b6b9-b3ce119b7e33 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:55.835202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b852d554-90a7-4599-b6b9-b3ce119b7e33 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:55.835656 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b852d554-90a7-4599-b6b9-b3ce119b7e33 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:55.836087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b852d554-90a7-4599-b6b9-b3ce119b7e33 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:55.968028 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b852d554-90a7-4599-b6b9-b3ce119b7e33 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:55.975526 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-b852d554-90a7-4599-b6b9-b3ce119b7e33 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a" status: 200 len: 1318 microversion: 2.1 time: 0.153905 Aug 24 08:00:55.976098 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 314/631] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:55 2022] GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:56.176047 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-5e077904-95e2-4c4e-a806-76b07f22bf6a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:56.176848 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-5e077904-95e2-4c4e-a806-76b07f22bf6a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:56.183490 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5e077904-95e2-4c4e-a806-76b07f22bf6a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:56.184062 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5e077904-95e2-4c4e-a806-76b07f22bf6a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:56.184571 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5e077904-95e2-4c4e-a806-76b07f22bf6a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:56.185997 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5e077904-95e2-4c4e-a806-76b07f22bf6a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:56.186511 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5e077904-95e2-4c4e-a806-76b07f22bf6a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:56.187109 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5e077904-95e2-4c4e-a806-76b07f22bf6a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:56.222081 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5e077904-95e2-4c4e-a806-76b07f22bf6a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:56.222592 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5e077904-95e2-4c4e-a806-76b07f22bf6a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:56.223021 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5e077904-95e2-4c4e-a806-76b07f22bf6a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:56.223468 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.objects.instance [None req-5e077904-95e2-4c4e-a806-76b07f22bf6a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lazy-loading 'fault' on Instance uuid f31397ec-5acf-4a90-a500-280a47ed1f55 {{(pid=127590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:00:56.268134 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-5e077904-95e2-4c4e-a806-76b07f22bf6a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:56.285301 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-5e077904-95e2-4c4e-a806-76b07f22bf6a tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 200 len: 1334 microversion: 2.1 time: 0.114472 Aug 24 08:00:56.285301 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 318/632] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:56 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 1334 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:56.995564 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-6debfb7b-f64c-4259-a148-66f075f31981 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:56.996166 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-6debfb7b-f64c-4259-a148-66f075f31981 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:57.002486 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6debfb7b-f64c-4259-a148-66f075f31981 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:57.002961 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6debfb7b-f64c-4259-a148-66f075f31981 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:57.003388 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6debfb7b-f64c-4259-a148-66f075f31981 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:57.004068 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6debfb7b-f64c-4259-a148-66f075f31981 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:57.004516 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6debfb7b-f64c-4259-a148-66f075f31981 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:57.004960 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6debfb7b-f64c-4259-a148-66f075f31981 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:57.136105 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-6debfb7b-f64c-4259-a148-66f075f31981 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:00:57.144333 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-6debfb7b-f64c-4259-a148-66f075f31981 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a" status: 200 len: 1507 microversion: 2.1 time: 0.152599 Aug 24 08:00:57.144931 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 315/633] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:56 2022] GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:00:57.165797 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-f474eb33-9379-425e-a17a-5fb7104806f9 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7132ec71-94b1-477e-b9fb-27fefd5cc80b", "device": "/dev/sdb"}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:00:57.168345 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-f474eb33-9379-425e-a17a-5fb7104806f9 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:57.174872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f474eb33-9379-425e-a17a-5fb7104806f9 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:57.175353 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f474eb33-9379-425e-a17a-5fb7104806f9 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:57.175783 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f474eb33-9379-425e-a17a-5fb7104806f9 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:57.176470 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f474eb33-9379-425e-a17a-5fb7104806f9 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:57.177073 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f474eb33-9379-425e-a17a-5fb7104806f9 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:57.177366 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f474eb33-9379-425e-a17a-5fb7104806f9 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:57.306503 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-3daf1caa-3f4e-4680-8312-47c0550beae7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:57.307149 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-3daf1caa-3f4e-4680-8312-47c0550beae7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: f31397ec-5acf-4a90-a500-280a47ed1f55] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:00:57.317952 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3daf1caa-3f4e-4680-8312-47c0550beae7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:57.319783 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3daf1caa-3f4e-4680-8312-47c0550beae7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:57.320341 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3daf1caa-3f4e-4680-8312-47c0550beae7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:57.321079 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3daf1caa-3f4e-4680-8312-47c0550beae7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:00:57.321649 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3daf1caa-3f4e-4680-8312-47c0550beae7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:00:57.322204 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3daf1caa-3f4e-4680-8312-47c0550beae7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:00:57.337314 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-3daf1caa-3f4e-4680-8312-47c0550beae7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] HTTP exception thrown: Instance f31397ec-5acf-4a90-a500-280a47ed1f55 could not be found. Aug 24 08:00:57.338966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-3daf1caa-3f4e-4680-8312-47c0550beae7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Request method failure captured: Aug 24 08:00:57.338966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 HTTP/1.1 Aug 24 08:00:57.338966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 08:00:57.338966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 08:00:57.338966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 08:00:57.338966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 08:00:57.338966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 08:00:57.338966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 08:00:57.338966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 08:00:57.338966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 08:00:57.338966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdl77mMuddCdCHjWrd8DH39AXHJIXv_-vLiyIketMjF1z0b7hh5tClcXlKlUUpe1LXwWnzheC-DGqeDS2yPf8oVj7oRphdHRib4NxjdH4iuB81Vj3VJAsKDThkhA68xfK2yl5RQVIZgDuEu0yeMW2l7InWT4D9Yx0eT-Xgtq0jRxlN8 Aug 24 08:00:57.338966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 08:00:57.338966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 08:00:57.338966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 08:00:57.338966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 08:00:57.338966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 08:00:57.338966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 08:00:57.338966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: e52495240cf04548a21b411c32bbe1e1 Aug 24 08:00:57.338966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1800569160 Aug 24 08:00:57.338966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 08:00:57.338966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 08:00:57.342346 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_e52495240cf04548a21b411c32bbe1e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/e52495240cf04548a21b411c32bbe1e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/e52495240cf04548a21b411c32bbe1e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/e52495240cf04548a21b411c32bbe1e1"}]}] Aug 24 08:00:57.342346 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1800569160 Aug 24 08:00:57.342346 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: e52495240cf04548a21b411c32bbe1e1 Aug 24 08:00:57.342346 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1800569160 Aug 24 08:00:57.342346 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-ServerRescueNegativeTestJSON-1800569160-project Aug 24 08:00:57.342346 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 08:00:57.342346 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 08:00:57.342346 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 51729e82a3784d04aef89ed83f1576bd Aug 24 08:00:57.342346 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1800569160-project Aug 24 08:00:57.342346 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 08:00:57.342346 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Instance f31397ec-5acf-4a90-a500-280a47ed1f55 could not be found. Aug 24 08:00:57.342346 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': 'f31397ec-5acf-4a90-a500-280a47ed1f55'} Aug 24 08:00:57.343710 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:00:57.343710 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:00:57.343710 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:00:57.343710 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:00:57.343710 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:00:57.343710 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:00:57.343710 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:00:57.343710 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:00:57.343710 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:00:57.343710 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:00:57.343710 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f31397ec-5acf-4a90-a500-280a47ed1f55 could not be found. Aug 24 08:00:57.343710 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:00:57.343710 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:00:57.343710 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:00:57.343710 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:00:57.343710 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:00:57.343710 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:00:57.343710 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:00:57.343710 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:00:57.343710 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:00:57.346590 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:00:57.346590 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:00:57.346590 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:00:57.346590 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:00:57.346590 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:00:57.346590 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:00:57.346590 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:00:57.346590 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f31397ec-5acf-4a90-a500-280a47ed1f55 could not be found. Aug 24 08:00:57.346590 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:00:57.346590 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:00:57.346590 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:00:57.346590 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:00:57.346590 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:00:57.346590 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:00:57.346590 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:00:57.346590 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:00:57.346590 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f31397ec-5acf-4a90-a500-280a47ed1f55 could not be found. Aug 24 08:00:57.346590 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:00:57.348765 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-3daf1caa-3f4e-4680-8312-47c0550beae7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Returning 404 to user: Instance f31397ec-5acf-4a90-a500-280a47ed1f55 could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:00:57.348765 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-3daf1caa-3f4e-4680-8312-47c0550beae7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55" status: 404 len: 111 microversion: 2.1 time: 0.037885 Aug 24 08:00:57.348765 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 316/634] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:00:57 2022] GET /compute/v2.1/servers/f31397ec-5acf-4a90-a500-280a47ed1f55 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:00:57.349545 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-7775e511-7df7-448c-8158-c8a74d8b1341 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '.version_select at 0x7f320ca24af0>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:00:57.469782 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-7775e511-7df7-448c-8158-c8a74d8b1341 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-322158287" status: 202 len: 0 microversion: 2.1 time: 0.123567 Aug 24 08:00:57.470468 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 317/635] 10.222.0.72 () {58 vars in 1218 bytes} [Wed Aug 24 08:00:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-322158287 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 08:00:57.839602 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:57.989722 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-f474eb33-9379-425e-a17a-5fb7104806f9 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "POST /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.827461 Aug 24 08:00:57.990384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 319/636] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 24 08:00:57 2022] POST /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a/os-volume_attachments => generated 194 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:01:00.924942 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-9a92dd15-4616-4a26-973d-f99bfd62f0e1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:00.925464 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-9a92dd15-4616-4a26-973d-f99bfd62f0e1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:00.931900 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9a92dd15-4616-4a26-973d-f99bfd62f0e1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:00.932384 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9a92dd15-4616-4a26-973d-f99bfd62f0e1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:00.932852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9a92dd15-4616-4a26-973d-f99bfd62f0e1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:00.933545 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9a92dd15-4616-4a26-973d-f99bfd62f0e1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:00.933999 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9a92dd15-4616-4a26-973d-f99bfd62f0e1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:00.934424 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9a92dd15-4616-4a26-973d-f99bfd62f0e1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:00.952423 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:00.959401 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-9a92dd15-4616-4a26-973d-f99bfd62f0e1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Going to try to terminate instance {{(pid=127589) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:01:01.264196 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-9a92dd15-4616-4a26-973d-f99bfd62f0e1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "DELETE /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 204 len: 0 microversion: 2.1 time: 0.342860 Aug 24 08:01:01.265254 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 318/637] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 24 08:01:00 2022] DELETE /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:01:01.275036 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-76b10045-c281-44f0-a65e-ffebedefe93f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:01.275841 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-76b10045-c281-44f0-a65e-ffebedefe93f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:01.284366 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-76b10045-c281-44f0-a65e-ffebedefe93f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:01.286410 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-76b10045-c281-44f0-a65e-ffebedefe93f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:01.286410 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-76b10045-c281-44f0-a65e-ffebedefe93f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:01.286410 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-76b10045-c281-44f0-a65e-ffebedefe93f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:01.286721 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-76b10045-c281-44f0-a65e-ffebedefe93f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:01.287017 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-76b10045-c281-44f0-a65e-ffebedefe93f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:01.429815 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-76b10045-c281-44f0-a65e-ffebedefe93f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:01.437871 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-76b10045-c281-44f0-a65e-ffebedefe93f tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1507 microversion: 2.1 time: 0.168103 Aug 24 08:01:01.438365 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 320/638] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:01 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:02.459476 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-c5885d1d-599b-4533-a064-b0d62da588da tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:02.460171 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-c5885d1d-599b-4533-a064-b0d62da588da tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:02.467434 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c5885d1d-599b-4533-a064-b0d62da588da tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:02.468030 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c5885d1d-599b-4533-a064-b0d62da588da tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:02.468463 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c5885d1d-599b-4533-a064-b0d62da588da tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:02.469185 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c5885d1d-599b-4533-a064-b0d62da588da tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:02.469629 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c5885d1d-599b-4533-a064-b0d62da588da tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:02.470047 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c5885d1d-599b-4533-a064-b0d62da588da tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:02.603172 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-c5885d1d-599b-4533-a064-b0d62da588da tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:02.611085 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-c5885d1d-599b-4533-a064-b0d62da588da tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1507 microversion: 2.1 time: 0.155748 Aug 24 08:01:02.611642 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 319/639] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:02 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:03.631854 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-535c6f35-b06e-4893-9dfd-102e5f3ee62e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:03.632461 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-535c6f35-b06e-4893-9dfd-102e5f3ee62e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:03.639926 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-535c6f35-b06e-4893-9dfd-102e5f3ee62e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:03.640405 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-535c6f35-b06e-4893-9dfd-102e5f3ee62e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:03.640875 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-535c6f35-b06e-4893-9dfd-102e5f3ee62e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:03.641577 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-535c6f35-b06e-4893-9dfd-102e5f3ee62e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:03.642028 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-535c6f35-b06e-4893-9dfd-102e5f3ee62e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:03.642448 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-535c6f35-b06e-4893-9dfd-102e5f3ee62e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:03.779612 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-535c6f35-b06e-4893-9dfd-102e5f3ee62e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:03.787490 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-535c6f35-b06e-4893-9dfd-102e5f3ee62e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1507 microversion: 2.1 time: 0.159560 Aug 24 08:01:03.788044 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 321/640] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:03 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:04.483723 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-a101d2f0-f538-46a9-bc9a-3f02dc3202df req-79e5ecb2-52de-4d17-9904-e634fd9447fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f68297f-844b-4ab5-a37a-6bccb85cb78a", "name": "network-vif-deleted", "tag": "49b68683-54d3-4b18-ac8e-682c0ebad5ee"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:01:04.493106 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-a101d2f0-f538-46a9-bc9a-3f02dc3202df req-79e5ecb2-52de-4d17-9904-e634fd9447fc service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:04.493581 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-a101d2f0-f538-46a9-bc9a-3f02dc3202df req-79e5ecb2-52de-4d17-9904-e634fd9447fc service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:04.494009 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-a101d2f0-f538-46a9-bc9a-3f02dc3202df req-79e5ecb2-52de-4d17-9904-e634fd9447fc service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:04.505056 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-a101d2f0-f538-46a9-bc9a-3f02dc3202df req-79e5ecb2-52de-4d17-9904-e634fd9447fc service nova] Creating event network-vif-deleted:49b68683-54d3-4b18-ac8e-682c0ebad5ee for instance 8f68297f-844b-4ab5-a37a-6bccb85cb78a on hv-cinder-85427 Aug 24 08:01:04.509706 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-a101d2f0-f538-46a9-bc9a-3f02dc3202df req-79e5ecb2-52de-4d17-9904-e634fd9447fc service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100731 Aug 24 08:01:04.510280 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 320/641] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:01:04.807452 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-c1aa6f46-7ba7-4948-a5fa-ef50f6c006e6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:04.808064 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-c1aa6f46-7ba7-4948-a5fa-ef50f6c006e6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:04.814502 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c1aa6f46-7ba7-4948-a5fa-ef50f6c006e6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:04.814984 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c1aa6f46-7ba7-4948-a5fa-ef50f6c006e6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:04.815422 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c1aa6f46-7ba7-4948-a5fa-ef50f6c006e6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:04.816113 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c1aa6f46-7ba7-4948-a5fa-ef50f6c006e6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:04.816574 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c1aa6f46-7ba7-4948-a5fa-ef50f6c006e6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:04.817030 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c1aa6f46-7ba7-4948-a5fa-ef50f6c006e6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:04.881323 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-c1aa6f46-7ba7-4948-a5fa-ef50f6c006e6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:04.889685 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-c1aa6f46-7ba7-4948-a5fa-ef50f6c006e6 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 200 len: 1293 microversion: 2.1 time: 0.086218 Aug 24 08:01:04.890246 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 322/642] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:04 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:05.911844 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-edd143d9-4dc9-4da9-b688-c2d60ec6b065 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:05.913245 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-edd143d9-4dc9-4da9-b688-c2d60ec6b065 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: 8f68297f-844b-4ab5-a37a-6bccb85cb78a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:05.919294 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-edd143d9-4dc9-4da9-b688-c2d60ec6b065 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:05.919770 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-edd143d9-4dc9-4da9-b688-c2d60ec6b065 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:05.920205 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-edd143d9-4dc9-4da9-b688-c2d60ec6b065 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:05.920923 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-edd143d9-4dc9-4da9-b688-c2d60ec6b065 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:05.921398 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-edd143d9-4dc9-4da9-b688-c2d60ec6b065 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:05.922373 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-edd143d9-4dc9-4da9-b688-c2d60ec6b065 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:05.935426 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-edd143d9-4dc9-4da9-b688-c2d60ec6b065 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] HTTP exception thrown: Instance 8f68297f-844b-4ab5-a37a-6bccb85cb78a could not be found. Aug 24 08:01:05.937070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-edd143d9-4dc9-4da9-b688-c2d60ec6b065 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Request method failure captured: Aug 24 08:01:05.937070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a HTTP/1.1 Aug 24 08:01:05.937070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 08:01:05.937070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 08:01:05.937070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 08:01:05.937070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 08:01:05.937070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 08:01:05.937070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 08:01:05.937070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 08:01:05.937070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 08:01:05.937070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdl77mMuddCdCHjWrd8DH39AXHJIXv_-vLiyIketMjF1z0b7hh5tClcXlKlUUpe1LXwWnzheC-DGqeDS2yPf8oVj7oRphdHRib4NxjdH4iuB81Vj3VJAsKDThkhA68xfK2yl5RQVIZgDuEu0yeMW2l7InWT4D9Yx0eT-Xgtq0jRxlN8 Aug 24 08:01:05.937070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 08:01:05.937070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 08:01:05.937070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 08:01:05.937070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 08:01:05.937070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 08:01:05.937070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 08:01:05.937070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: e52495240cf04548a21b411c32bbe1e1 Aug 24 08:01:05.937070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1800569160 Aug 24 08:01:05.937070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 08:01:05.937070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 08:01:05.938701 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_e52495240cf04548a21b411c32bbe1e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/e52495240cf04548a21b411c32bbe1e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/e52495240cf04548a21b411c32bbe1e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/e52495240cf04548a21b411c32bbe1e1"}]}] Aug 24 08:01:05.938701 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1800569160 Aug 24 08:01:05.938701 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: e52495240cf04548a21b411c32bbe1e1 Aug 24 08:01:05.938701 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1800569160 Aug 24 08:01:05.938701 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-ServerRescueNegativeTestJSON-1800569160-project Aug 24 08:01:05.938701 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 08:01:05.938701 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 08:01:05.938701 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 51729e82a3784d04aef89ed83f1576bd Aug 24 08:01:05.938701 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1800569160-project Aug 24 08:01:05.938701 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 08:01:05.938701 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Instance 8f68297f-844b-4ab5-a37a-6bccb85cb78a could not be found. Aug 24 08:01:05.938701 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': '8f68297f-844b-4ab5-a37a-6bccb85cb78a'} Aug 24 08:01:05.939652 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:01:05.939652 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:01:05.939652 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:01:05.939652 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:01:05.939652 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:01:05.939652 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:01:05.939652 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:01:05.939652 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:01:05.939652 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:01:05.939652 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:01:05.939652 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f68297f-844b-4ab5-a37a-6bccb85cb78a could not be found. Aug 24 08:01:05.939652 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:01:05.939652 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:01:05.939652 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:01:05.939652 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:01:05.939652 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:01:05.939652 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:01:05.939652 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:01:05.939652 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:01:05.939652 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:01:05.941131 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:01:05.941131 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:01:05.941131 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:01:05.941131 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:01:05.941131 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:01:05.941131 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:01:05.941131 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:01:05.941131 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f68297f-844b-4ab5-a37a-6bccb85cb78a could not be found. Aug 24 08:01:05.941131 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:01:05.941131 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:01:05.941131 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:01:05.941131 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:01:05.941131 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:01:05.941131 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:01:05.941131 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:01:05.941131 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:01:05.941131 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f68297f-844b-4ab5-a37a-6bccb85cb78a could not be found. Aug 24 08:01:05.941131 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:01:05.942367 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-edd143d9-4dc9-4da9-b688-c2d60ec6b065 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Returning 404 to user: Instance 8f68297f-844b-4ab5-a37a-6bccb85cb78a could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:01:05.942367 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-edd143d9-4dc9-4da9-b688-c2d60ec6b065 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a" status: 404 len: 111 microversion: 2.1 time: 0.031640 Aug 24 08:01:05.942367 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 321/643] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:05 2022] GET /compute/v2.1/servers/8f68297f-844b-4ab5-a37a-6bccb85cb78a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:01:05.947275 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-ee3afc76-44b1-45f4-9ff3-242f5a18edf8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:05.947828 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-ee3afc76-44b1-45f4-9ff3-242f5a18edf8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:05.954493 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ee3afc76-44b1-45f4-9ff3-242f5a18edf8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:05.955218 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ee3afc76-44b1-45f4-9ff3-242f5a18edf8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:05.955403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ee3afc76-44b1-45f4-9ff3-242f5a18edf8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:05.956100 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ee3afc76-44b1-45f4-9ff3-242f5a18edf8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:05.956552 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ee3afc76-44b1-45f4-9ff3-242f5a18edf8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:05.957003 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ee3afc76-44b1-45f4-9ff3-242f5a18edf8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:05.982120 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-ee3afc76-44b1-45f4-9ff3-242f5a18edf8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Going to try to terminate instance {{(pid=127590) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:01:06.318247 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-ee3afc76-44b1-45f4-9ff3-242f5a18edf8 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "DELETE /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 204 len: 0 microversion: 2.1 time: 0.374571 Aug 24 08:01:06.318839 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 323/644] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 24 08:01:05 2022] DELETE /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:01:06.327131 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-45928902-e294-46ff-bc05-33bb1791c291 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:06.329512 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-45928902-e294-46ff-bc05-33bb1791c291 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:06.334215 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-45928902-e294-46ff-bc05-33bb1791c291 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:06.334680 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-45928902-e294-46ff-bc05-33bb1791c291 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:06.335118 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-45928902-e294-46ff-bc05-33bb1791c291 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:06.335835 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-45928902-e294-46ff-bc05-33bb1791c291 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:06.336289 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-45928902-e294-46ff-bc05-33bb1791c291 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:06.336741 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-45928902-e294-46ff-bc05-33bb1791c291 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:06.466883 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-45928902-e294-46ff-bc05-33bb1791c291 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:06.475382 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-45928902-e294-46ff-bc05-33bb1791c291 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 200 len: 1521 microversion: 2.1 time: 0.152108 Aug 24 08:01:06.475943 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 322/645] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:06 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:01:07.496868 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-5c0f9a10-aff6-49f1-bef2-1e0912904ce2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:07.497503 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-5c0f9a10-aff6-49f1-bef2-1e0912904ce2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:07.503996 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5c0f9a10-aff6-49f1-bef2-1e0912904ce2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:07.504471 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5c0f9a10-aff6-49f1-bef2-1e0912904ce2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:07.504937 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5c0f9a10-aff6-49f1-bef2-1e0912904ce2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:07.505620 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5c0f9a10-aff6-49f1-bef2-1e0912904ce2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:07.506067 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5c0f9a10-aff6-49f1-bef2-1e0912904ce2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:07.506532 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5c0f9a10-aff6-49f1-bef2-1e0912904ce2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:07.636565 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-5c0f9a10-aff6-49f1-bef2-1e0912904ce2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:07.644977 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-5c0f9a10-aff6-49f1-bef2-1e0912904ce2 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 200 len: 1521 microversion: 2.1 time: 0.152413 Aug 24 08:01:07.645579 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 324/646] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:07 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:08.666741 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-910f12f7-d31e-40df-b5b6-bd9eeb181d89 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:08.667304 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-910f12f7-d31e-40df-b5b6-bd9eeb181d89 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:08.674298 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-910f12f7-d31e-40df-b5b6-bd9eeb181d89 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:08.674779 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-910f12f7-d31e-40df-b5b6-bd9eeb181d89 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:08.675219 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-910f12f7-d31e-40df-b5b6-bd9eeb181d89 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:08.675916 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-910f12f7-d31e-40df-b5b6-bd9eeb181d89 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:08.676371 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-910f12f7-d31e-40df-b5b6-bd9eeb181d89 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:08.676834 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-910f12f7-d31e-40df-b5b6-bd9eeb181d89 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:08.808234 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-910f12f7-d31e-40df-b5b6-bd9eeb181d89 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:08.815948 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-910f12f7-d31e-40df-b5b6-bd9eeb181d89 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 200 len: 1521 microversion: 2.1 time: 0.153166 Aug 24 08:01:08.816500 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 323/647] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:08 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:09.836975 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-e08a53d8-219e-4280-afa1-a0827d2474c3 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:09.837575 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-e08a53d8-219e-4280-afa1-a0827d2474c3 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:09.843972 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e08a53d8-219e-4280-afa1-a0827d2474c3 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:09.844442 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e08a53d8-219e-4280-afa1-a0827d2474c3 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:09.844903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e08a53d8-219e-4280-afa1-a0827d2474c3 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:09.845744 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e08a53d8-219e-4280-afa1-a0827d2474c3 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:09.846192 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e08a53d8-219e-4280-afa1-a0827d2474c3 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:09.846608 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e08a53d8-219e-4280-afa1-a0827d2474c3 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:09.974759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-e08a53d8-219e-4280-afa1-a0827d2474c3 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:09.982879 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-e08a53d8-219e-4280-afa1-a0827d2474c3 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 200 len: 1521 microversion: 2.1 time: 0.149659 Aug 24 08:01:09.983453 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 325/648] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:09 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:11.004662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-baf9fa8e-5071-43d6-b2a9-485c398823a7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:11.005273 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-baf9fa8e-5071-43d6-b2a9-485c398823a7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:11.011637 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-baf9fa8e-5071-43d6-b2a9-485c398823a7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:11.012138 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-baf9fa8e-5071-43d6-b2a9-485c398823a7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:11.012566 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-baf9fa8e-5071-43d6-b2a9-485c398823a7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:11.013268 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-baf9fa8e-5071-43d6-b2a9-485c398823a7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:11.013715 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-baf9fa8e-5071-43d6-b2a9-485c398823a7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:11.014129 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-baf9fa8e-5071-43d6-b2a9-485c398823a7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:11.139137 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-baf9fa8e-5071-43d6-b2a9-485c398823a7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:11.147685 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-baf9fa8e-5071-43d6-b2a9-485c398823a7 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 200 len: 1521 microversion: 2.1 time: 0.146904 Aug 24 08:01:11.148235 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 324/649] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:10 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:11.396363 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-909d466f-3c9d-4529-b4ce-5449e02fd873 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:01:11.398673 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-909d466f-3c9d-4529-b4ce-5449e02fd873 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:11.401223 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:11.412853 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-909d466f-3c9d-4529-b4ce-5449e02fd873 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:11.412853 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-909d466f-3c9d-4529-b4ce-5449e02fd873 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:11.412853 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-909d466f-3c9d-4529-b4ce-5449e02fd873 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:11.412853 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-909d466f-3c9d-4529-b4ce-5449e02fd873 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:11.413243 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-909d466f-3c9d-4529-b4ce-5449e02fd873 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:11.413243 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-909d466f-3c9d-4529-b4ce-5449e02fd873 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:11.688067 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-909d466f-3c9d-4529-b4ce-5449e02fd873 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "POST /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68/action" status: 202 len: 0 microversion: 2.1 time: 0.294601 Aug 24 08:01:11.688916 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 326/650] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 24 08:01:11 2022] POST /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:01:11.696955 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b591a167-2775-429e-ba8b-4018fcf69b38 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:11.697570 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-b591a167-2775-429e-ba8b-4018fcf69b38 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:11.703742 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b591a167-2775-429e-ba8b-4018fcf69b38 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:11.704217 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b591a167-2775-429e-ba8b-4018fcf69b38 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:11.704660 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b591a167-2775-429e-ba8b-4018fcf69b38 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:11.705357 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b591a167-2775-429e-ba8b-4018fcf69b38 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:11.705807 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b591a167-2775-429e-ba8b-4018fcf69b38 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:11.706228 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b591a167-2775-429e-ba8b-4018fcf69b38 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:11.849109 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b591a167-2775-429e-ba8b-4018fcf69b38 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:11.857776 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-b591a167-2775-429e-ba8b-4018fcf69b38 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1752 microversion: 2.1 time: 0.164820 Aug 24 08:01:11.858567 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 325/651] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:11 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:12.169930 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-f91b82d7-cca6-4f72-a908-6114ae6265cc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:12.170625 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-f91b82d7-cca6-4f72-a908-6114ae6265cc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:12.176881 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f91b82d7-cca6-4f72-a908-6114ae6265cc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:12.177367 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f91b82d7-cca6-4f72-a908-6114ae6265cc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:12.177811 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f91b82d7-cca6-4f72-a908-6114ae6265cc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:12.178539 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f91b82d7-cca6-4f72-a908-6114ae6265cc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:12.178975 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f91b82d7-cca6-4f72-a908-6114ae6265cc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:12.179399 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f91b82d7-cca6-4f72-a908-6114ae6265cc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:12.312070 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-f91b82d7-cca6-4f72-a908-6114ae6265cc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:12.320148 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-f91b82d7-cca6-4f72-a908-6114ae6265cc tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 200 len: 1521 microversion: 2.1 time: 0.154422 Aug 24 08:01:12.320727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 327/652] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:12 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:01:12.879952 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-130cbd4f-99a0-4f47-ac5d-c978faa34c23 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:12.880542 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-130cbd4f-99a0-4f47-ac5d-c978faa34c23 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:12.883034 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:12.887658 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-130cbd4f-99a0-4f47-ac5d-c978faa34c23 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:12.888128 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-130cbd4f-99a0-4f47-ac5d-c978faa34c23 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:12.888557 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-130cbd4f-99a0-4f47-ac5d-c978faa34c23 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:12.889262 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-130cbd4f-99a0-4f47-ac5d-c978faa34c23 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:12.889707 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-130cbd4f-99a0-4f47-ac5d-c978faa34c23 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:12.890149 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-130cbd4f-99a0-4f47-ac5d-c978faa34c23 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:13.033899 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-130cbd4f-99a0-4f47-ac5d-c978faa34c23 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:13.042090 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-130cbd4f-99a0-4f47-ac5d-c978faa34c23 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1752 microversion: 2.1 time: 0.165958 Aug 24 08:01:13.042648 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 326/653] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:12 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:13.341976 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-07f84bc3-7a7d-4259-99fc-1f5d7f3ef0a1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:13.342664 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-07f84bc3-7a7d-4259-99fc-1f5d7f3ef0a1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:13.349845 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-07f84bc3-7a7d-4259-99fc-1f5d7f3ef0a1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:13.350329 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-07f84bc3-7a7d-4259-99fc-1f5d7f3ef0a1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:13.350769 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-07f84bc3-7a7d-4259-99fc-1f5d7f3ef0a1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:13.351458 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-07f84bc3-7a7d-4259-99fc-1f5d7f3ef0a1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:13.351909 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-07f84bc3-7a7d-4259-99fc-1f5d7f3ef0a1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:13.352336 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-07f84bc3-7a7d-4259-99fc-1f5d7f3ef0a1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:13.483382 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-07f84bc3-7a7d-4259-99fc-1f5d7f3ef0a1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:13.491809 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-07f84bc3-7a7d-4259-99fc-1f5d7f3ef0a1 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 200 len: 1521 microversion: 2.1 time: 0.153742 Aug 24 08:01:13.492492 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 328/654] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:13 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:14.069448 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b4d7ec02-543f-4ebf-96e3-727a1a9c0916 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:14.070062 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-b4d7ec02-543f-4ebf-96e3-727a1a9c0916 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:14.079233 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b4d7ec02-543f-4ebf-96e3-727a1a9c0916 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:14.079727 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b4d7ec02-543f-4ebf-96e3-727a1a9c0916 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:14.080166 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b4d7ec02-543f-4ebf-96e3-727a1a9c0916 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:14.080975 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b4d7ec02-543f-4ebf-96e3-727a1a9c0916 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:14.081431 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b4d7ec02-543f-4ebf-96e3-727a1a9c0916 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:14.081854 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b4d7ec02-543f-4ebf-96e3-727a1a9c0916 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:14.325222 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b4d7ec02-543f-4ebf-96e3-727a1a9c0916 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:14.338853 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-b4d7ec02-543f-4ebf-96e3-727a1a9c0916 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1752 microversion: 2.1 time: 0.275295 Aug 24 08:01:14.339661 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 327/655] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:14 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1752 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:14.356036 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-5cccd69e-abdf-4598-b900-38b0d2c42428 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:14.356606 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-5cccd69e-abdf-4598-b900-38b0d2c42428 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:14.363160 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5cccd69e-abdf-4598-b900-38b0d2c42428 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:14.363856 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5cccd69e-abdf-4598-b900-38b0d2c42428 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:14.364481 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5cccd69e-abdf-4598-b900-38b0d2c42428 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:14.365378 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5cccd69e-abdf-4598-b900-38b0d2c42428 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:14.366123 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5cccd69e-abdf-4598-b900-38b0d2c42428 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:14.366712 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5cccd69e-abdf-4598-b900-38b0d2c42428 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:14.395899 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-5cccd69e-abdf-4598-b900-38b0d2c42428 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7/ips" status: 200 len: 151 microversion: 2.20 time: 0.111170 Aug 24 08:01:14.396708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 329/656] 10.222.0.72 () {60 vars in 1289 bytes} [Wed Aug 24 08:01:14 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7/ips => generated 151 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 08:01:14.513041 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-acf449a0-08cb-4669-ba4a-1586c0d91c1e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:14.513659 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-acf449a0-08cb-4669-ba4a-1586c0d91c1e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:14.520046 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-acf449a0-08cb-4669-ba4a-1586c0d91c1e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:14.521087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-acf449a0-08cb-4669-ba4a-1586c0d91c1e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:14.521718 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-acf449a0-08cb-4669-ba4a-1586c0d91c1e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:14.523345 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-acf449a0-08cb-4669-ba4a-1586c0d91c1e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:14.523993 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-acf449a0-08cb-4669-ba4a-1586c0d91c1e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:14.524897 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-acf449a0-08cb-4669-ba4a-1586c0d91c1e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:14.695228 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-acf449a0-08cb-4669-ba4a-1586c0d91c1e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:14.703011 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-acf449a0-08cb-4669-ba4a-1586c0d91c1e tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 200 len: 1521 microversion: 2.1 time: 0.193906 Aug 24 08:01:14.703575 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 328/657] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:14 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:14.912413 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-5d69bca0-c578-4068-a653-4379d7518bc8 req-1039df91-48d3-4c2e-b872-86957518edbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb0fc412-e048-4edd-9a89-5aaaebb38a42", "name": "network-vif-deleted", "tag": "5a81c1e6-d657-4fb4-a660-b452ce1735b0"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:01:14.921908 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-5d69bca0-c578-4068-a653-4379d7518bc8 req-1039df91-48d3-4c2e-b872-86957518edbf service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:14.922431 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-5d69bca0-c578-4068-a653-4379d7518bc8 req-1039df91-48d3-4c2e-b872-86957518edbf service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:14.922861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-5d69bca0-c578-4068-a653-4379d7518bc8 req-1039df91-48d3-4c2e-b872-86957518edbf service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:14.935944 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-5d69bca0-c578-4068-a653-4379d7518bc8 req-1039df91-48d3-4c2e-b872-86957518edbf service nova] Creating event network-vif-deleted:5a81c1e6-d657-4fb4-a660-b452ce1735b0 for instance fb0fc412-e048-4edd-9a89-5aaaebb38a42 on hv-cinder-85427 Aug 24 08:01:14.941305 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-5d69bca0-c578-4068-a653-4379d7518bc8 req-1039df91-48d3-4c2e-b872-86957518edbf service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089054 Aug 24 08:01:14.941888 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 330/658] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:01:15.360107 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-f8e49f17-819d-4622-a924-1efb313b187d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:15.361153 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-f8e49f17-819d-4622-a924-1efb313b187d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:15.367734 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f8e49f17-819d-4622-a924-1efb313b187d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:15.368210 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f8e49f17-819d-4622-a924-1efb313b187d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:15.368640 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f8e49f17-819d-4622-a924-1efb313b187d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:15.369348 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f8e49f17-819d-4622-a924-1efb313b187d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:15.369794 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f8e49f17-819d-4622-a924-1efb313b187d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:15.370210 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f8e49f17-819d-4622-a924-1efb313b187d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:15.527410 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-f8e49f17-819d-4622-a924-1efb313b187d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:15.536602 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-f8e49f17-819d-4622-a924-1efb313b187d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1757 microversion: 2.1 time: 0.181152 Aug 24 08:01:15.537190 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 329/659] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:15 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:15.729104 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-9958872d-4f8f-4871-a9c3-217b04e88c19 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:15.729859 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-9958872d-4f8f-4871-a9c3-217b04e88c19 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:15.736560 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9958872d-4f8f-4871-a9c3-217b04e88c19 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:15.741222 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9958872d-4f8f-4871-a9c3-217b04e88c19 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:15.741222 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9958872d-4f8f-4871-a9c3-217b04e88c19 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:15.741222 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9958872d-4f8f-4871-a9c3-217b04e88c19 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:15.741222 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9958872d-4f8f-4871-a9c3-217b04e88c19 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:15.741615 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9958872d-4f8f-4871-a9c3-217b04e88c19 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:15.770143 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9958872d-4f8f-4871-a9c3-217b04e88c19 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:15.770625 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9958872d-4f8f-4871-a9c3-217b04e88c19 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:15.771057 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9958872d-4f8f-4871-a9c3-217b04e88c19 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:15.771501 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.objects.instance [None req-9958872d-4f8f-4871-a9c3-217b04e88c19 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lazy-loading 'fault' on Instance uuid fb0fc412-e048-4edd-9a89-5aaaebb38a42 {{(pid=127590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:01:15.817821 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9958872d-4f8f-4871-a9c3-217b04e88c19 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51729e82a3784d04aef89ed83f1576bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52495240cf04548a21b411c32bbe1e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:15.825961 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-9958872d-4f8f-4871-a9c3-217b04e88c19 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 200 len: 1311 microversion: 2.1 time: 0.101613 Aug 24 08:01:15.827422 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 331/660] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:15 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:16.563277 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-95d9b542-26b9-4d0d-b84b-a12976c53600 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:16.563893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-95d9b542-26b9-4d0d-b84b-a12976c53600 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:16.570377 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-95d9b542-26b9-4d0d-b84b-a12976c53600 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:16.570885 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-95d9b542-26b9-4d0d-b84b-a12976c53600 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:16.571350 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-95d9b542-26b9-4d0d-b84b-a12976c53600 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:16.572043 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-95d9b542-26b9-4d0d-b84b-a12976c53600 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:16.572498 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-95d9b542-26b9-4d0d-b84b-a12976c53600 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:16.572953 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-95d9b542-26b9-4d0d-b84b-a12976c53600 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:16.718149 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-95d9b542-26b9-4d0d-b84b-a12976c53600 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:16.726357 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-95d9b542-26b9-4d0d-b84b-a12976c53600 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1757 microversion: 2.1 time: 0.167598 Aug 24 08:01:16.726928 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 330/661] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:16 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:16.754038 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-4d503d56-c060-4a6b-9d44-145fef3fda2e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:01:16.754632 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-4d503d56-c060-4a6b-9d44-145fef3fda2e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:16.761146 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4d503d56-c060-4a6b-9d44-145fef3fda2e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:16.761632 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4d503d56-c060-4a6b-9d44-145fef3fda2e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:16.762073 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4d503d56-c060-4a6b-9d44-145fef3fda2e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:16.762762 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4d503d56-c060-4a6b-9d44-145fef3fda2e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:16.763236 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4d503d56-c060-4a6b-9d44-145fef3fda2e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:16.763649 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4d503d56-c060-4a6b-9d44-145fef3fda2e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:16.785762 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.objects.instance [None req-4d503d56-c060-4a6b-9d44-145fef3fda2e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lazy-loading 'flavor' on Instance uuid 771d249a-e50d-4848-b6ab-cb76685964d7 {{(pid=127590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:01:16.847142 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-38c21f8c-61bf-41ad-b3ed-271ae9c8ee16 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:16.847743 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-38c21f8c-61bf-41ad-b3ed-271ae9c8ee16 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] [instance: fb0fc412-e048-4edd-9a89-5aaaebb38a42] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:16.853633 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-38c21f8c-61bf-41ad-b3ed-271ae9c8ee16 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:16.854109 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-38c21f8c-61bf-41ad-b3ed-271ae9c8ee16 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:16.854558 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-38c21f8c-61bf-41ad-b3ed-271ae9c8ee16 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:16.855242 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-38c21f8c-61bf-41ad-b3ed-271ae9c8ee16 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:16.855692 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-38c21f8c-61bf-41ad-b3ed-271ae9c8ee16 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:16.856106 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-38c21f8c-61bf-41ad-b3ed-271ae9c8ee16 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:16.869860 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-38c21f8c-61bf-41ad-b3ed-271ae9c8ee16 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] HTTP exception thrown: Instance fb0fc412-e048-4edd-9a89-5aaaebb38a42 could not be found. Aug 24 08:01:16.871366 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-38c21f8c-61bf-41ad-b3ed-271ae9c8ee16 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Request method failure captured: Aug 24 08:01:16.871366 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 HTTP/1.1 Aug 24 08:01:16.871366 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 08:01:16.871366 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 08:01:16.871366 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 08:01:16.871366 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 08:01:16.871366 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 08:01:16.871366 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 08:01:16.871366 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 08:01:16.871366 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 08:01:16.871366 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdl77mMuddCdCHjWrd8DH39AXHJIXv_-vLiyIketMjF1z0b7hh5tClcXlKlUUpe1LXwWnzheC-DGqeDS2yPf8oVj7oRphdHRib4NxjdH4iuB81Vj3VJAsKDThkhA68xfK2yl5RQVIZgDuEu0yeMW2l7InWT4D9Yx0eT-Xgtq0jRxlN8 Aug 24 08:01:16.871366 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 08:01:16.871366 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 08:01:16.871366 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 08:01:16.871366 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 08:01:16.871366 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 08:01:16.871366 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 08:01:16.871366 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: e52495240cf04548a21b411c32bbe1e1 Aug 24 08:01:16.871366 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1800569160 Aug 24 08:01:16.871366 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 08:01:16.871366 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 08:01:16.875527 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_e52495240cf04548a21b411c32bbe1e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/e52495240cf04548a21b411c32bbe1e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/e52495240cf04548a21b411c32bbe1e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/e52495240cf04548a21b411c32bbe1e1"}]}] Aug 24 08:01:16.875527 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1800569160 Aug 24 08:01:16.875527 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: e52495240cf04548a21b411c32bbe1e1 Aug 24 08:01:16.875527 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1800569160 Aug 24 08:01:16.875527 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-ServerRescueNegativeTestJSON-1800569160-project Aug 24 08:01:16.875527 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 08:01:16.875527 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 08:01:16.875527 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 51729e82a3784d04aef89ed83f1576bd Aug 24 08:01:16.875527 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1800569160-project Aug 24 08:01:16.875527 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 08:01:16.875527 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Instance fb0fc412-e048-4edd-9a89-5aaaebb38a42 could not be found. Aug 24 08:01:16.875527 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': 'fb0fc412-e048-4edd-9a89-5aaaebb38a42'} Aug 24 08:01:16.876320 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:01:16.876320 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:01:16.876320 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:01:16.876320 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:01:16.876320 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:01:16.876320 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:01:16.876320 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:01:16.876320 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:01:16.876320 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:01:16.876320 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:01:16.876320 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb0fc412-e048-4edd-9a89-5aaaebb38a42 could not be found. Aug 24 08:01:16.876320 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:01:16.876320 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:01:16.876320 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:01:16.876320 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:01:16.876320 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:01:16.876320 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:01:16.876320 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:01:16.876320 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:01:16.876320 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:01:16.877591 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:01:16.877591 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:01:16.877591 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:01:16.877591 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:01:16.877591 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:01:16.877591 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:01:16.877591 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:01:16.877591 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb0fc412-e048-4edd-9a89-5aaaebb38a42 could not be found. Aug 24 08:01:16.877591 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:01:16.877591 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:01:16.877591 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:01:16.877591 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:01:16.877591 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:01:16.877591 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:01:16.877591 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:01:16.877591 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:01:16.877591 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb0fc412-e048-4edd-9a89-5aaaebb38a42 could not be found. Aug 24 08:01:16.877591 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:01:16.878948 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-38c21f8c-61bf-41ad-b3ed-271ae9c8ee16 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] Returning 404 to user: Instance fb0fc412-e048-4edd-9a89-5aaaebb38a42 could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:01:16.878948 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-38c21f8c-61bf-41ad-b3ed-271ae9c8ee16 tempest-ServerRescueNegativeTestJSON-1800569160 tempest-ServerRescueNegativeTestJSON-1800569160-project] 10.222.0.72 "GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42" status: 404 len: 111 microversion: 2.1 time: 0.029452 Aug 24 08:01:16.878948 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 331/662] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:16 2022] GET /compute/v2.1/servers/fb0fc412-e048-4edd-9a89-5aaaebb38a42 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 08:01:16.884977 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:17.278775 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-4d503d56-c060-4a6b-9d44-145fef3fda2e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "POST /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7/action" status: 202 len: 0 microversion: 2.20 time: 0.528743 Aug 24 08:01:17.279587 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 332/663] 10.222.0.72 () {62 vars in 1319 bytes} [Wed Aug 24 08:01:16 2022] POST /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:01:17.290698 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-487ee9b8-80c0-4546-834a-5dcd96bb4ca5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:17.291394 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-487ee9b8-80c0-4546-834a-5dcd96bb4ca5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:17.298643 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-487ee9b8-80c0-4546-834a-5dcd96bb4ca5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:17.299323 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-487ee9b8-80c0-4546-834a-5dcd96bb4ca5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:17.299836 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-487ee9b8-80c0-4546-834a-5dcd96bb4ca5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:17.300951 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-487ee9b8-80c0-4546-834a-5dcd96bb4ca5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:17.301509 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-487ee9b8-80c0-4546-834a-5dcd96bb4ca5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:17.302062 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-487ee9b8-80c0-4546-834a-5dcd96bb4ca5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:17.449462 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-487ee9b8-80c0-4546-834a-5dcd96bb4ca5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:17.458137 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-487ee9b8-80c0-4546-834a-5dcd96bb4ca5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:17.459880 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-487ee9b8-80c0-4546-834a-5dcd96bb4ca5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:17.460875 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-487ee9b8-80c0-4546-834a-5dcd96bb4ca5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1723 microversion: 2.20 time: 0.176590 Aug 24 08:01:17.461418 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 332/664] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:17 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:17.747970 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-1b9de89d-fe10-47d1-9323-3802903ce766 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:17.749030 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-1b9de89d-fe10-47d1-9323-3802903ce766 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:17.755380 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1b9de89d-fe10-47d1-9323-3802903ce766 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:17.755970 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1b9de89d-fe10-47d1-9323-3802903ce766 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:17.761272 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1b9de89d-fe10-47d1-9323-3802903ce766 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:17.761272 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1b9de89d-fe10-47d1-9323-3802903ce766 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:17.761272 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1b9de89d-fe10-47d1-9323-3802903ce766 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:17.761272 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1b9de89d-fe10-47d1-9323-3802903ce766 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:17.981801 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-1b9de89d-fe10-47d1-9323-3802903ce766 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:17.991042 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-1b9de89d-fe10-47d1-9323-3802903ce766 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1757 microversion: 2.1 time: 0.247280 Aug 24 08:01:17.991906 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 333/665] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:17 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1757 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:18.169376 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-8c59a038-1c07-4fe9-9ee5-7ab50938d292 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:18.169945 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-8c59a038-1c07-4fe9-9ee5-7ab50938d292 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:18.176631 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8c59a038-1c07-4fe9-9ee5-7ab50938d292 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:18.177237 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8c59a038-1c07-4fe9-9ee5-7ab50938d292 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:18.177764 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8c59a038-1c07-4fe9-9ee5-7ab50938d292 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:18.178598 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8c59a038-1c07-4fe9-9ee5-7ab50938d292 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:18.179120 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8c59a038-1c07-4fe9-9ee5-7ab50938d292 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:18.179610 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8c59a038-1c07-4fe9-9ee5-7ab50938d292 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:18.263493 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.objects.instance [None req-8c59a038-1c07-4fe9-9ee5-7ab50938d292 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lazy-loading 'services' on Instance uuid 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a {{(pid=127589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:01:18.465799 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-8c59a038-1c07-4fe9-9ee5-7ab50938d292 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "DELETE /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a/os-volume_attachments/7132ec71-94b1-477e-b9fb-27fefd5cc80b" status: 202 len: 0 microversion: 2.1 time: 0.300275 Aug 24 08:01:18.466387 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 333/666] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 24 08:01:18 2022] DELETE /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a/os-volume_attachments/7132ec71-94b1-477e-b9fb-27fefd5cc80b => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:01:18.483654 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-78e16915-9cba-416f-913c-7dc451b7d69c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:18.485235 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-78e16915-9cba-416f-913c-7dc451b7d69c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:18.491433 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-78e16915-9cba-416f-913c-7dc451b7d69c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:18.491921 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-78e16915-9cba-416f-913c-7dc451b7d69c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:18.492618 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-78e16915-9cba-416f-913c-7dc451b7d69c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:18.493541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-78e16915-9cba-416f-913c-7dc451b7d69c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:18.494640 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-78e16915-9cba-416f-913c-7dc451b7d69c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:18.494640 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-78e16915-9cba-416f-913c-7dc451b7d69c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:18.733055 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-78e16915-9cba-416f-913c-7dc451b7d69c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:18.746554 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-78e16915-9cba-416f-913c-7dc451b7d69c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:18.748443 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-78e16915-9cba-416f-913c-7dc451b7d69c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:18.749394 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-78e16915-9cba-416f-913c-7dc451b7d69c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1723 microversion: 2.20 time: 0.269713 Aug 24 08:01:18.764708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 334/667] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:18 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:19.014641 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-02765c6c-8ffc-4c33-ab47-89b353d6a5e1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:19.016100 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-02765c6c-8ffc-4c33-ab47-89b353d6a5e1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:19.023823 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-02765c6c-8ffc-4c33-ab47-89b353d6a5e1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:19.024571 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-02765c6c-8ffc-4c33-ab47-89b353d6a5e1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:19.025265 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-02765c6c-8ffc-4c33-ab47-89b353d6a5e1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:19.026062 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-02765c6c-8ffc-4c33-ab47-89b353d6a5e1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:19.027178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-02765c6c-8ffc-4c33-ab47-89b353d6a5e1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:19.027853 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-02765c6c-8ffc-4c33-ab47-89b353d6a5e1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:19.248611 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-02765c6c-8ffc-4c33-ab47-89b353d6a5e1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:19.260030 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:19.270549 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-02765c6c-8ffc-4c33-ab47-89b353d6a5e1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1757 microversion: 2.1 time: 0.261421 Aug 24 08:01:19.274258 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 334/668] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:19 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1757 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:19.593249 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-5fd55a81-22fd-4e20-81eb-a1607ccbb61a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:19.593849 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-5fd55a81-22fd-4e20-81eb-a1607ccbb61a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:19.600413 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5fd55a81-22fd-4e20-81eb-a1607ccbb61a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:19.601200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5fd55a81-22fd-4e20-81eb-a1607ccbb61a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:19.601640 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5fd55a81-22fd-4e20-81eb-a1607ccbb61a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:19.602376 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5fd55a81-22fd-4e20-81eb-a1607ccbb61a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:19.602848 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5fd55a81-22fd-4e20-81eb-a1607ccbb61a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:19.603490 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5fd55a81-22fd-4e20-81eb-a1607ccbb61a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:19.630279 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-5fd55a81-22fd-4e20-81eb-a1607ccbb61a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a] Going to try to terminate instance {{(pid=127590) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:01:19.776481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-28be3005-e0fd-4c63-be49-7193610c7568 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:19.776481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-28be3005-e0fd-4c63-be49-7193610c7568 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:19.781215 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-28be3005-e0fd-4c63-be49-7193610c7568 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:19.782077 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-28be3005-e0fd-4c63-be49-7193610c7568 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:19.782501 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-28be3005-e0fd-4c63-be49-7193610c7568 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:19.783217 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-28be3005-e0fd-4c63-be49-7193610c7568 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:19.783670 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-28be3005-e0fd-4c63-be49-7193610c7568 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:19.784093 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-28be3005-e0fd-4c63-be49-7193610c7568 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:19.926570 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-28be3005-e0fd-4c63-be49-7193610c7568 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:19.934610 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-28be3005-e0fd-4c63-be49-7193610c7568 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:19.936124 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-28be3005-e0fd-4c63-be49-7193610c7568 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:19.938451 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-28be3005-e0fd-4c63-be49-7193610c7568 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1723 microversion: 2.20 time: 0.168810 Aug 24 08:01:19.952776 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 335/669] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:19 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:01:19.987884 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-5fd55a81-22fd-4e20-81eb-a1607ccbb61a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "DELETE /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a" status: 204 len: 0 microversion: 2.1 time: 0.400429 Aug 24 08:01:19.988458 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 335/670] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 24 08:01:19 2022] DELETE /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:01:19.997539 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-f9012cae-c4f3-4a3c-b181-63ef2ef08fbb tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:19.998156 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-f9012cae-c4f3-4a3c-b181-63ef2ef08fbb tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:20.004752 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f9012cae-c4f3-4a3c-b181-63ef2ef08fbb tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:20.005246 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f9012cae-c4f3-4a3c-b181-63ef2ef08fbb tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:20.005677 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f9012cae-c4f3-4a3c-b181-63ef2ef08fbb tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:20.006394 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f9012cae-c4f3-4a3c-b181-63ef2ef08fbb tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:20.006884 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f9012cae-c4f3-4a3c-b181-63ef2ef08fbb tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:20.007310 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f9012cae-c4f3-4a3c-b181-63ef2ef08fbb tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:20.157707 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-f9012cae-c4f3-4a3c-b181-63ef2ef08fbb tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:20.166228 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-f9012cae-c4f3-4a3c-b181-63ef2ef08fbb tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a" status: 200 len: 1513 microversion: 2.1 time: 0.173072 Aug 24 08:01:20.167404 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 336/671] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:19 2022] GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:20.292800 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-7b21ab47-20d5-4633-b988-66335488e088 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:20.293027 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-7b21ab47-20d5-4633-b988-66335488e088 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:20.302190 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7b21ab47-20d5-4633-b988-66335488e088 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:20.302679 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7b21ab47-20d5-4633-b988-66335488e088 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:20.303192 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7b21ab47-20d5-4633-b988-66335488e088 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:20.303904 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7b21ab47-20d5-4633-b988-66335488e088 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:20.305448 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7b21ab47-20d5-4633-b988-66335488e088 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:20.305870 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7b21ab47-20d5-4633-b988-66335488e088 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:20.549988 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-7b21ab47-20d5-4633-b988-66335488e088 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:20.558552 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-7b21ab47-20d5-4633-b988-66335488e088 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1757 microversion: 2.1 time: 0.270633 Aug 24 08:01:20.560871 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 336/672] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:20 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1757 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:20.960725 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-a69ad439-3711-4e00-b19c-8cec3b9fc863 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:20.961411 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-a69ad439-3711-4e00-b19c-8cec3b9fc863 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:20.968047 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a69ad439-3711-4e00-b19c-8cec3b9fc863 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:20.971004 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a69ad439-3711-4e00-b19c-8cec3b9fc863 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:20.971004 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a69ad439-3711-4e00-b19c-8cec3b9fc863 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:20.971004 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a69ad439-3711-4e00-b19c-8cec3b9fc863 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:20.971004 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a69ad439-3711-4e00-b19c-8cec3b9fc863 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:20.971345 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a69ad439-3711-4e00-b19c-8cec3b9fc863 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:21.105050 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a69ad439-3711-4e00-b19c-8cec3b9fc863 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:21.113716 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a69ad439-3711-4e00-b19c-8cec3b9fc863 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:21.115254 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a69ad439-3711-4e00-b19c-8cec3b9fc863 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:21.116402 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-a69ad439-3711-4e00-b19c-8cec3b9fc863 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1723 microversion: 2.20 time: 0.159929 Aug 24 08:01:21.117009 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 337/673] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:20 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:21.189084 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-818ca5cf-c9cb-4895-94e3-968b4d6caa1a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:21.189684 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-818ca5cf-c9cb-4895-94e3-968b4d6caa1a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:21.196053 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-818ca5cf-c9cb-4895-94e3-968b4d6caa1a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:21.196522 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-818ca5cf-c9cb-4895-94e3-968b4d6caa1a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:21.196982 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-818ca5cf-c9cb-4895-94e3-968b4d6caa1a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:21.197668 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-818ca5cf-c9cb-4895-94e3-968b4d6caa1a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:21.198111 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-818ca5cf-c9cb-4895-94e3-968b4d6caa1a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:21.198524 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-818ca5cf-c9cb-4895-94e3-968b4d6caa1a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:21.339041 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-818ca5cf-c9cb-4895-94e3-968b4d6caa1a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:21.347530 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-818ca5cf-c9cb-4895-94e3-968b4d6caa1a tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a" status: 200 len: 1513 microversion: 2.1 time: 0.162973 Aug 24 08:01:21.348337 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 337/674] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:21 2022] GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:21.579865 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b25add59-627d-4540-a9f9-44944465396e tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:21.580889 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-b25add59-627d-4540-a9f9-44944465396e tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:21.587026 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b25add59-627d-4540-a9f9-44944465396e tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:21.587512 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b25add59-627d-4540-a9f9-44944465396e tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:21.587976 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b25add59-627d-4540-a9f9-44944465396e tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:21.588700 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b25add59-627d-4540-a9f9-44944465396e tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:21.589153 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b25add59-627d-4540-a9f9-44944465396e tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:21.589822 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b25add59-627d-4540-a9f9-44944465396e tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:21.780555 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b25add59-627d-4540-a9f9-44944465396e tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:21.789731 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-b25add59-627d-4540-a9f9-44944465396e tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1757 microversion: 2.1 time: 0.213929 Aug 24 08:01:21.790384 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 338/675] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:21 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1757 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:22.140137 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-43bb4813-76a9-40f9-acd0-a0fd8a57fea3 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:22.141330 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-43bb4813-76a9-40f9-acd0-a0fd8a57fea3 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:22.147369 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-43bb4813-76a9-40f9-acd0-a0fd8a57fea3 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:22.151164 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-43bb4813-76a9-40f9-acd0-a0fd8a57fea3 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:22.151164 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-43bb4813-76a9-40f9-acd0-a0fd8a57fea3 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:22.151164 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-43bb4813-76a9-40f9-acd0-a0fd8a57fea3 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:22.151164 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-43bb4813-76a9-40f9-acd0-a0fd8a57fea3 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:22.151500 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-43bb4813-76a9-40f9-acd0-a0fd8a57fea3 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:22.301365 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-43bb4813-76a9-40f9-acd0-a0fd8a57fea3 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:22.311749 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-43bb4813-76a9-40f9-acd0-a0fd8a57fea3 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:22.313806 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-43bb4813-76a9-40f9-acd0-a0fd8a57fea3 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:22.315009 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-43bb4813-76a9-40f9-acd0-a0fd8a57fea3 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1723 microversion: 2.20 time: 0.178915 Aug 24 08:01:22.323213 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 338/676] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:22 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:22.324470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-520ae48a-56ae-4da1-ac92-77e23d939c3a req-3e2955a0-84b4-4d2b-8cea-40d30b220038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "584a6731-7b9d-4ffb-aacd-14d40a3bdc4a", "name": "network-vif-deleted", "tag": "596000da-fcc8-40ef-a757-9986f310fce4"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:01:22.340046 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-520ae48a-56ae-4da1-ac92-77e23d939c3a req-3e2955a0-84b4-4d2b-8cea-40d30b220038 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:22.340449 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-520ae48a-56ae-4da1-ac92-77e23d939c3a req-3e2955a0-84b4-4d2b-8cea-40d30b220038 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:22.340911 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-520ae48a-56ae-4da1-ac92-77e23d939c3a req-3e2955a0-84b4-4d2b-8cea-40d30b220038 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:22.352210 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-520ae48a-56ae-4da1-ac92-77e23d939c3a req-3e2955a0-84b4-4d2b-8cea-40d30b220038 service nova] Creating event network-vif-deleted:596000da-fcc8-40ef-a757-9986f310fce4 for instance 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a on hv-cinder-85427 Aug 24 08:01:22.357069 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-520ae48a-56ae-4da1-ac92-77e23d939c3a req-3e2955a0-84b4-4d2b-8cea-40d30b220038 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037735 Aug 24 08:01:22.357658 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 339/677] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:01:22.370166 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-ce58ebb2-ad6a-4598-bbe0-4f7c31b9fcb2 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:22.370806 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-ce58ebb2-ad6a-4598-bbe0-4f7c31b9fcb2 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:22.377772 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ce58ebb2-ad6a-4598-bbe0-4f7c31b9fcb2 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:22.378356 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ce58ebb2-ad6a-4598-bbe0-4f7c31b9fcb2 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:22.378800 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ce58ebb2-ad6a-4598-bbe0-4f7c31b9fcb2 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:22.379506 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ce58ebb2-ad6a-4598-bbe0-4f7c31b9fcb2 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:22.379988 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ce58ebb2-ad6a-4598-bbe0-4f7c31b9fcb2 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:22.380414 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ce58ebb2-ad6a-4598-bbe0-4f7c31b9fcb2 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:22.452269 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-ce58ebb2-ad6a-4598-bbe0-4f7c31b9fcb2 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8de6b6200840dbb9c4d7a3b728f9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c534e991899e457c8b41e1dbc12a6670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:22.462716 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-ce58ebb2-ad6a-4598-bbe0-4f7c31b9fcb2 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a" status: 200 len: 1471 microversion: 2.1 time: 0.096667 Aug 24 08:01:22.467519 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 339/678] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:22 2022] GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a => generated 1471 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:22.812084 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-cd8c8025-7ed7-456f-92a1-efe3e129650b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:22.813538 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-cd8c8025-7ed7-456f-92a1-efe3e129650b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:22.820399 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cd8c8025-7ed7-456f-92a1-efe3e129650b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:22.820914 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cd8c8025-7ed7-456f-92a1-efe3e129650b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:22.824627 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cd8c8025-7ed7-456f-92a1-efe3e129650b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:22.824627 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cd8c8025-7ed7-456f-92a1-efe3e129650b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:22.824627 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cd8c8025-7ed7-456f-92a1-efe3e129650b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:22.824627 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cd8c8025-7ed7-456f-92a1-efe3e129650b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:22.937209 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-d0584236-6d02-4401-8af5-0f978ee1c87d tempest-VolumesGetTestJSON-1069689944 tempest-VolumesGetTestJSON-1069689944-project] Action: 'create', calling method: .version_select at 0x7f320c1d71f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-581217130", "metadata": {"Type": "work"}}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:01:22.971034 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-cd8c8025-7ed7-456f-92a1-efe3e129650b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:22.979748 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-cd8c8025-7ed7-456f-92a1-efe3e129650b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1757 microversion: 2.1 time: 0.171888 Aug 24 08:01:22.980313 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 340/679] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:22 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:01:23.346501 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-4de4e2ce-7b30-4ac1-bd0e-cb3b5377b545 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:23.347143 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-4de4e2ce-7b30-4ac1-bd0e-cb3b5377b545 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:23.353531 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4de4e2ce-7b30-4ac1-bd0e-cb3b5377b545 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:23.354541 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4de4e2ce-7b30-4ac1-bd0e-cb3b5377b545 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:23.354541 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4de4e2ce-7b30-4ac1-bd0e-cb3b5377b545 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:23.355170 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4de4e2ce-7b30-4ac1-bd0e-cb3b5377b545 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:23.355615 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4de4e2ce-7b30-4ac1-bd0e-cb3b5377b545 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:23.356034 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4de4e2ce-7b30-4ac1-bd0e-cb3b5377b545 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:23.489097 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-4de4e2ce-7b30-4ac1-bd0e-cb3b5377b545 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:23.497244 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-4de4e2ce-7b30-4ac1-bd0e-cb3b5377b545 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:23.498755 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-4de4e2ce-7b30-4ac1-bd0e-cb3b5377b545 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:23.499913 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-4de4e2ce-7b30-4ac1-bd0e-cb3b5377b545 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1723 microversion: 2.20 time: 0.158004 Aug 24 08:01:23.500474 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 341/680] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:23 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:01:23.505062 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-46e1ff65-6257-44e4-ad1c-788da279c689 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:23.505660 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-46e1ff65-6257-44e4-ad1c-788da279c689 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] [instance: 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:23.511192 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-46e1ff65-6257-44e4-ad1c-788da279c689 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:23.511694 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-46e1ff65-6257-44e4-ad1c-788da279c689 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:23.512126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-46e1ff65-6257-44e4-ad1c-788da279c689 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:23.512840 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-46e1ff65-6257-44e4-ad1c-788da279c689 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:23.513289 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-46e1ff65-6257-44e4-ad1c-788da279c689 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:23.513704 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-46e1ff65-6257-44e4-ad1c-788da279c689 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:23.527320 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-46e1ff65-6257-44e4-ad1c-788da279c689 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] HTTP exception thrown: Instance 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a could not be found. Aug 24 08:01:23.528990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-46e1ff65-6257-44e4-ad1c-788da279c689 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Request method failure captured: Aug 24 08:01:23.528990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a HTTP/1.1 Aug 24 08:01:23.528990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 08:01:23.528990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 08:01:23.528990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 08:01:23.528990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 08:01:23.528990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 08:01:23.528990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 08:01:23.528990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 08:01:23.528990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 08:01:23.528990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdo-lYGksuV4OitjTy6WnepYpTbdqaR4rMaSwOArfw6HNdxDmvNBP3td3HE9wwgg_bdKYILBPK2vzODlsCJgesxmea0QGVnew7mgsf9lVxzkQeOOrxddDDVFRCFJV29ATwZzAZ9JfujE4NU7OZx9nK93dDkTrzwirXgcQMnvRwHRNj0 Aug 24 08:01:23.528990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 08:01:23.528990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 08:01:23.528990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 08:01:23.528990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 08:01:23.528990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 08:01:23.528990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 08:01:23.528990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: c534e991899e457c8b41e1dbc12a6670 Aug 24 08:01:23.528990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-VolumesSnapshotTestJSON-913144663 Aug 24 08:01:23.528990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 08:01:23.528990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 08:01:23.530363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_c534e991899e457c8b41e1dbc12a6670"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/c534e991899e457c8b41e1dbc12a6670"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c534e991899e457c8b41e1dbc12a6670"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c534e991899e457c8b41e1dbc12a6670"}]}] Aug 24 08:01:23.530363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-VolumesSnapshotTestJSON-913144663 Aug 24 08:01:23.530363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: c534e991899e457c8b41e1dbc12a6670 Aug 24 08:01:23.530363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-913144663 Aug 24 08:01:23.530363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-VolumesSnapshotTestJSON-913144663-project Aug 24 08:01:23.530363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 08:01:23.530363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 08:01:23.530363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 5a8de6b6200840dbb9c4d7a3b728f9c2 Aug 24 08:01:23.530363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-VolumesSnapshotTestJSON-913144663-project Aug 24 08:01:23.530363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 08:01:23.530363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Instance 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a could not be found. Aug 24 08:01:23.530363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': '584a6731-7b9d-4ffb-aacd-14d40a3bdc4a'} Aug 24 08:01:23.532023 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:01:23.532023 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:01:23.532023 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:01:23.532023 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:01:23.532023 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:01:23.532023 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:01:23.532023 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:01:23.532023 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:01:23.532023 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:01:23.532023 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:01:23.532023 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a could not be found. Aug 24 08:01:23.532023 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:01:23.532023 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:01:23.532023 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:01:23.532023 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:01:23.532023 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:01:23.532023 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:01:23.532023 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:01:23.532023 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:01:23.532023 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:01:23.533278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:01:23.533278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:01:23.533278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:01:23.533278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:01:23.533278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:01:23.533278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:01:23.533278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:01:23.533278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a could not be found. Aug 24 08:01:23.533278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:01:23.533278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:01:23.533278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:01:23.533278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:01:23.533278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:01:23.533278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:01:23.533278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:01:23.533278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:01:23.533278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a could not be found. Aug 24 08:01:23.533278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:01:23.534371 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-46e1ff65-6257-44e4-ad1c-788da279c689 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] Returning 404 to user: Instance 584a6731-7b9d-4ffb-aacd-14d40a3bdc4a could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:01:23.534371 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-46e1ff65-6257-44e4-ad1c-788da279c689 tempest-VolumesSnapshotTestJSON-913144663 tempest-VolumesSnapshotTestJSON-913144663-project] 10.222.0.72 "GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a" status: 404 len: 111 microversion: 2.1 time: 0.029194 Aug 24 08:01:23.534371 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 342/681] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:23 2022] GET /compute/v2.1/servers/584a6731-7b9d-4ffb-aacd-14d40a3bdc4a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:01:23.600463 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-d0584236-6d02-4401-8af5-0f978ee1c87d tempest-VolumesGetTestJSON-1069689944 tempest-VolumesGetTestJSON-1069689944-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.779146 Aug 24 08:01:23.603644 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 340/682] 10.222.0.72 () {60 vars in 1156 bytes} [Wed Aug 24 08:01:22 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 781 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 24 08:01:23.613373 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-52372d54-f998-4589-a60c-69e04e119142 tempest-VolumesGetTestJSON-1069689944 tempest-VolumesGetTestJSON-1069689944-project] Calling method '.version_select at 0x7f320c9b85e0>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:23.666040 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-52372d54-f998-4589-a60c-69e04e119142 tempest-VolumesGetTestJSON-1069689944 tempest-VolumesGetTestJSON-1069689944-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/8e91e8ff-68e7-4e46-aa39-921d404f150d" status: 200 len: 352 microversion: 2.1 time: 0.055961 Aug 24 08:01:23.672739 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 343/683] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 24 08:01:23 2022] GET /compute/v2.1/os-volumes/8e91e8ff-68e7-4e46-aa39-921d404f150d => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:01:24.002088 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-dc35c60b-6882-4bb7-b96a-6d8b18668431 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:24.002696 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-dc35c60b-6882-4bb7-b96a-6d8b18668431 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:24.009580 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dc35c60b-6882-4bb7-b96a-6d8b18668431 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:24.010055 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dc35c60b-6882-4bb7-b96a-6d8b18668431 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:24.014539 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dc35c60b-6882-4bb7-b96a-6d8b18668431 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:24.014539 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dc35c60b-6882-4bb7-b96a-6d8b18668431 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:24.014539 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dc35c60b-6882-4bb7-b96a-6d8b18668431 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:24.014539 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dc35c60b-6882-4bb7-b96a-6d8b18668431 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:24.155872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-dc35c60b-6882-4bb7-b96a-6d8b18668431 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:24.165764 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-dc35c60b-6882-4bb7-b96a-6d8b18668431 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1757 microversion: 2.1 time: 0.168039 Aug 24 08:01:24.166333 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 341/684] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:23 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:24.523451 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-507722ef-d695-4420-ac45-728568191239 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:24.523998 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-507722ef-d695-4420-ac45-728568191239 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:24.530749 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-507722ef-d695-4420-ac45-728568191239 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:24.531997 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-507722ef-d695-4420-ac45-728568191239 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:24.532434 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-507722ef-d695-4420-ac45-728568191239 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:24.533167 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-507722ef-d695-4420-ac45-728568191239 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:24.533625 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-507722ef-d695-4420-ac45-728568191239 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:24.534053 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-507722ef-d695-4420-ac45-728568191239 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:24.662366 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-507722ef-d695-4420-ac45-728568191239 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:24.670599 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-507722ef-d695-4420-ac45-728568191239 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:24.672767 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-507722ef-d695-4420-ac45-728568191239 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:24.677565 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-507722ef-d695-4420-ac45-728568191239 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1723 microversion: 2.20 time: 0.155175 Aug 24 08:01:24.677565 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 344/685] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:24 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:24.680928 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-ed9c346d-b208-47ae-a8c8-d954afdabdee tempest-VolumesGetTestJSON-1069689944 tempest-VolumesGetTestJSON-1069689944-project] Calling method '.version_select at 0x7f320c1d7c10>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:24.729791 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-ed9c346d-b208-47ae-a8c8-d954afdabdee tempest-VolumesGetTestJSON-1069689944 tempest-VolumesGetTestJSON-1069689944-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/8e91e8ff-68e7-4e46-aa39-921d404f150d" status: 200 len: 353 microversion: 2.1 time: 0.052828 Aug 24 08:01:24.730353 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 342/686] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 24 08:01:24 2022] GET /compute/v2.1/os-volumes/8e91e8ff-68e7-4e46-aa39-921d404f150d => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:01:24.742962 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e61dde8a-7a57-4871-9ee1-3d21470ed701 tempest-VolumesGetTestJSON-1069689944 tempest-VolumesGetTestJSON-1069689944-project] Calling method '.version_select at 0x7f320c881ca0>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:24.796210 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-e61dde8a-7a57-4871-9ee1-3d21470ed701 tempest-VolumesGetTestJSON-1069689944 tempest-VolumesGetTestJSON-1069689944-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/8e91e8ff-68e7-4e46-aa39-921d404f150d" status: 200 len: 353 microversion: 2.1 time: 0.056995 Aug 24 08:01:24.796830 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 345/687] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 24 08:01:24 2022] GET /compute/v2.1/os-volumes/8e91e8ff-68e7-4e46-aa39-921d404f150d => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:01:24.815129 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-90f89b8a-31e9-478e-80eb-49adcec40104 tempest-VolumesGetTestJSON-1069689944 tempest-VolumesGetTestJSON-1069689944-project] Calling method '.version_select at 0x7f320c181820>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:24.989938 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-90f89b8a-31e9-478e-80eb-49adcec40104 tempest-VolumesGetTestJSON-1069689944 tempest-VolumesGetTestJSON-1069689944-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/8e91e8ff-68e7-4e46-aa39-921d404f150d" status: 202 len: 0 microversion: 2.1 time: 0.179363 Aug 24 08:01:24.990513 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 343/688] 10.222.0.72 () {58 vars in 1248 bytes} [Wed Aug 24 08:01:24 2022] DELETE /compute/v2.1/os-volumes/8e91e8ff-68e7-4e46-aa39-921d404f150d => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:01:24.999005 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-1c5e969f-4757-4a55-a717-f75980783ee7 tempest-VolumesGetTestJSON-1069689944 tempest-VolumesGetTestJSON-1069689944-project] Calling method '.version_select at 0x7f320c881700>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:25.044984 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-1c5e969f-4757-4a55-a717-f75980783ee7 tempest-VolumesGetTestJSON-1069689944 tempest-VolumesGetTestJSON-1069689944-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/8e91e8ff-68e7-4e46-aa39-921d404f150d" status: 200 len: 352 microversion: 2.1 time: 0.049790 Aug 24 08:01:25.045649 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 346/689] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 24 08:01:24 2022] GET /compute/v2.1/os-volumes/8e91e8ff-68e7-4e46-aa39-921d404f150d => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:01:25.187169 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-654f00c2-630d-4880-a006-7d17744f4467 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:25.188357 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-654f00c2-630d-4880-a006-7d17744f4467 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:25.195048 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-654f00c2-630d-4880-a006-7d17744f4467 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:25.195531 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-654f00c2-630d-4880-a006-7d17744f4467 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:25.195963 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-654f00c2-630d-4880-a006-7d17744f4467 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:25.196671 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-654f00c2-630d-4880-a006-7d17744f4467 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:25.197128 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-654f00c2-630d-4880-a006-7d17744f4467 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:25.197550 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-654f00c2-630d-4880-a006-7d17744f4467 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:25.344638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-654f00c2-630d-4880-a006-7d17744f4467 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:25.352979 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-654f00c2-630d-4880-a006-7d17744f4467 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1757 microversion: 2.1 time: 0.169662 Aug 24 08:01:25.353541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 344/690] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:25 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:25.711722 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b6058336-e710-4846-b117-c06a6976d491 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:25.712338 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-b6058336-e710-4846-b117-c06a6976d491 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:25.722354 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b6058336-e710-4846-b117-c06a6976d491 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:25.722912 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b6058336-e710-4846-b117-c06a6976d491 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:25.723354 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b6058336-e710-4846-b117-c06a6976d491 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:25.724062 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b6058336-e710-4846-b117-c06a6976d491 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:25.724705 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b6058336-e710-4846-b117-c06a6976d491 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:25.725140 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b6058336-e710-4846-b117-c06a6976d491 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:25.860641 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b6058336-e710-4846-b117-c06a6976d491 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:25.869147 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b6058336-e710-4846-b117-c06a6976d491 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:25.870761 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b6058336-e710-4846-b117-c06a6976d491 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:25.872023 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-b6058336-e710-4846-b117-c06a6976d491 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1723 microversion: 2.20 time: 0.167538 Aug 24 08:01:25.875561 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 347/691] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:25 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:26.059142 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-98799e61-4d53-4108-b056-7af9e388f207 tempest-VolumesGetTestJSON-1069689944 tempest-VolumesGetTestJSON-1069689944-project] Calling method '.version_select at 0x7f320c1d79d0>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:26.087755 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.wsgi [None req-98799e61-4d53-4108-b056-7af9e388f207 tempest-VolumesGetTestJSON-1069689944 tempest-VolumesGetTestJSON-1069689944-project] HTTP exception thrown: Volume 8e91e8ff-68e7-4e46-aa39-921d404f150d could not be found. Aug 24 08:01:26.089903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-98799e61-4d53-4108-b056-7af9e388f207 tempest-VolumesGetTestJSON-1069689944 tempest-VolumesGetTestJSON-1069689944-project] Request method failure captured: Aug 24 08:01:26.089903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: request: GET /compute/v2.1/os-volumes/8e91e8ff-68e7-4e46-aa39-921d404f150d HTTP/1.1 Aug 24 08:01:26.089903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept: application/json Aug 24 08:01:26.089903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept-Encoding: identity Aug 24 08:01:26.089903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Connection: close Aug 24 08:01:26.089903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Length: 0 Aug 24 08:01:26.089903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Type: application/json Aug 24 08:01:26.089903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Host: 10.222.0.72 Aug 24 08:01:26.089903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Openstack-System-Scope: None Aug 24 08:01:26.089903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: User-Agent: python-urllib3/1.26.11 Aug 24 08:01:26.089903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Auth-Token: gAAAAABjBdrSFpGRQqcsBOaGE1NB7Vwj7m68CGK3MKrJ14ePOkE0lr4BGns2FSMvMjNwy4-g8c9F7-aOGUNu1nZPZzHf85lEXZLd0K-ieiLJEsTNOIzbdBTFCPYYLGK7Yvw0G68RjaKG3gN1NWwKHAK0QPau-y2mMDIR3_Kf77KwxxDo_CeXDJg Aug 24 08:01:26.089903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Id: None Aug 24 08:01:26.089903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Name: None Aug 24 08:01:26.089903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Identity-Status: Confirmed Aug 24 08:01:26.089903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Is-Admin-Project: True Aug 24 08:01:26.089903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Id: default Aug 24 08:01:26.089903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Name: Default Aug 24 08:01:26.089903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Id: f4e18b3870e0429dbe00345d4fc9d462 Aug 24 08:01:26.089903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Name: tempest-VolumesGetTestJSON-1069689944 Aug 24 08:01:26.089903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Role: reader,member Aug 24 08:01:26.089903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Roles: reader,member Aug 24 08:01:26.091438 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_f4e18b3870e0429dbe00345d4fc9d462"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/f4e18b3870e0429dbe00345d4fc9d462"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f4e18b3870e0429dbe00345d4fc9d462"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f4e18b3870e0429dbe00345d4fc9d462"}]}] Aug 24 08:01:26.091438 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant: tempest-VolumesGetTestJSON-1069689944 Aug 24 08:01:26.091438 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Id: f4e18b3870e0429dbe00345d4fc9d462 Aug 24 08:01:26.091438 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Name: tempest-VolumesGetTestJSON-1069689944 Aug 24 08:01:26.091438 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User: tempest-VolumesGetTestJSON-1069689944-project Aug 24 08:01:26.091438 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Id: default Aug 24 08:01:26.091438 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Name: Default Aug 24 08:01:26.091438 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Id: 561edc3bedd64b70b926530507519dcf Aug 24 08:01:26.091438 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Name: tempest-VolumesGetTestJSON-1069689944-project Aug 24 08:01:26.091438 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: method: Aug 24 08:01:26.091438 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: exception: Volume 8e91e8ff-68e7-4e46-aa39-921d404f150d could not be found. Aug 24 08:01:26.091438 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: action_args: {'id': '8e91e8ff-68e7-4e46-aa39-921d404f150d'} Aug 24 08:01:26.091438 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:01:26.092403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:01:26.092403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:01:26.092403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:01:26.092403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 08:01:26.092403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 08:01:26.092403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 08:01:26.092403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 08:01:26.092403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 08:01:26.092403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 08:01:26.092403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 08:01:26.092403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 08:01:26.092403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:01:26.092403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:01:26.092403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:01:26.092403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:01:26.092403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8e91e8ff-68e7-4e46-aa39-921d404f150d could not be found. (HTTP 404) (Request-ID: req-fa321299-f780-4814-9fbf-68372ff84cd7) Aug 24 08:01:26.092403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:01:26.092403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:01:26.092403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:01:26.093785 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:01:26.093785 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 08:01:26.093785 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 08:01:26.093785 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 08:01:26.093785 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 08:01:26.093785 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 08:01:26.093785 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 08:01:26.093785 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 08:01:26.093785 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 08:01:26.093785 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:01:26.093785 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:01:26.093785 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 08:01:26.093785 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 08:01:26.093785 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 08:01:26.093785 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 08:01:26.093785 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 08:01:26.093785 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 08:01:26.093785 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 08:01:26.093785 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 08:01:26.095098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:01:26.095098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:01:26.095098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:01:26.095098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:01:26.095098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8e91e8ff-68e7-4e46-aa39-921d404f150d could not be found. Aug 24 08:01:26.095098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:01:26.095098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:01:26.095098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:01:26.095098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:01:26.095098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:01:26.095098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:01:26.095098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:01:26.095098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:01:26.095098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 08:01:26.095098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 08:01:26.095098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:01:26.095098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:01:26.095098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 08:01:26.095098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:01:26.096452 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8e91e8ff-68e7-4e46-aa39-921d404f150d could not be found. Aug 24 08:01:26.096452 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:01:26.096452 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:01:26.096452 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:01:26.096452 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:01:26.096452 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:01:26.096452 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:01:26.096452 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:01:26.096452 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:01:26.096452 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8e91e8ff-68e7-4e46-aa39-921d404f150d could not be found. Aug 24 08:01:26.096452 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:01:26.096452 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-98799e61-4d53-4108-b056-7af9e388f207 tempest-VolumesGetTestJSON-1069689944 tempest-VolumesGetTestJSON-1069689944-project] Returning 404 to user: Volume 8e91e8ff-68e7-4e46-aa39-921d404f150d could not be found. {{(pid=127590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:01:26.096452 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-98799e61-4d53-4108-b056-7af9e388f207 tempest-VolumesGetTestJSON-1069689944 tempest-VolumesGetTestJSON-1069689944-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/8e91e8ff-68e7-4e46-aa39-921d404f150d" status: 404 len: 109 microversion: 2.1 time: 0.036058 Aug 24 08:01:26.096452 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 345/692] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 24 08:01:26 2022] GET /compute/v2.1/os-volumes/8e91e8ff-68e7-4e46-aa39-921d404f150d => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:01:26.378607 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-dc8ae7b5-eab1-4c5e-8a2d-0a8bfeb49bf1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:26.379225 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-dc8ae7b5-eab1-4c5e-8a2d-0a8bfeb49bf1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:26.385367 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-dc8ae7b5-eab1-4c5e-8a2d-0a8bfeb49bf1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:26.385856 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-dc8ae7b5-eab1-4c5e-8a2d-0a8bfeb49bf1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:26.386301 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-dc8ae7b5-eab1-4c5e-8a2d-0a8bfeb49bf1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:26.387005 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-dc8ae7b5-eab1-4c5e-8a2d-0a8bfeb49bf1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:26.387463 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-dc8ae7b5-eab1-4c5e-8a2d-0a8bfeb49bf1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:26.387890 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-dc8ae7b5-eab1-4c5e-8a2d-0a8bfeb49bf1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:26.536337 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-dc8ae7b5-eab1-4c5e-8a2d-0a8bfeb49bf1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:26.544707 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-dc8ae7b5-eab1-4c5e-8a2d-0a8bfeb49bf1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1760 microversion: 2.1 time: 0.169988 Aug 24 08:01:26.545459 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 348/693] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:01:26 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1760 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:01:26.894880 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-328dbc08-4496-4cdd-95ed-247ed2af4959 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:26.895494 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-328dbc08-4496-4cdd-95ed-247ed2af4959 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:26.902261 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-328dbc08-4496-4cdd-95ed-247ed2af4959 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:26.902754 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-328dbc08-4496-4cdd-95ed-247ed2af4959 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:26.903196 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-328dbc08-4496-4cdd-95ed-247ed2af4959 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:26.903901 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-328dbc08-4496-4cdd-95ed-247ed2af4959 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:26.904361 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-328dbc08-4496-4cdd-95ed-247ed2af4959 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:26.904836 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-328dbc08-4496-4cdd-95ed-247ed2af4959 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:27.044635 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-328dbc08-4496-4cdd-95ed-247ed2af4959 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:27.052774 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-328dbc08-4496-4cdd-95ed-247ed2af4959 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:27.054397 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-328dbc08-4496-4cdd-95ed-247ed2af4959 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:27.055554 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-328dbc08-4496-4cdd-95ed-247ed2af4959 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1723 microversion: 2.20 time: 0.165196 Aug 24 08:01:27.056098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 346/694] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:26 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:28.079585 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-3b8a0884-0572-4869-a1bb-6ef78a623050 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:28.080189 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-3b8a0884-0572-4869-a1bb-6ef78a623050 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:28.086540 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3b8a0884-0572-4869-a1bb-6ef78a623050 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:28.087021 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3b8a0884-0572-4869-a1bb-6ef78a623050 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:28.087459 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3b8a0884-0572-4869-a1bb-6ef78a623050 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:28.088150 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3b8a0884-0572-4869-a1bb-6ef78a623050 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:28.088601 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3b8a0884-0572-4869-a1bb-6ef78a623050 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:28.089052 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3b8a0884-0572-4869-a1bb-6ef78a623050 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:28.217340 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-3b8a0884-0572-4869-a1bb-6ef78a623050 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:28.233033 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-3b8a0884-0572-4869-a1bb-6ef78a623050 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:28.235402 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-3b8a0884-0572-4869-a1bb-6ef78a623050 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:28.237302 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-3b8a0884-0572-4869-a1bb-6ef78a623050 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1723 microversion: 2.20 time: 0.161858 Aug 24 08:01:28.238166 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 349/695] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:28 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:29.262236 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-6e0eda57-7d0c-481e-ad74-bc3a655900e5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:29.262848 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-6e0eda57-7d0c-481e-ad74-bc3a655900e5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:29.269373 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6e0eda57-7d0c-481e-ad74-bc3a655900e5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:29.269924 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6e0eda57-7d0c-481e-ad74-bc3a655900e5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:29.270428 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6e0eda57-7d0c-481e-ad74-bc3a655900e5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:29.271211 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6e0eda57-7d0c-481e-ad74-bc3a655900e5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:29.271727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6e0eda57-7d0c-481e-ad74-bc3a655900e5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:29.272262 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6e0eda57-7d0c-481e-ad74-bc3a655900e5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:29.403256 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-6e0eda57-7d0c-481e-ad74-bc3a655900e5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:29.412498 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-6e0eda57-7d0c-481e-ad74-bc3a655900e5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:29.414101 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-6e0eda57-7d0c-481e-ad74-bc3a655900e5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:29.415247 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-6e0eda57-7d0c-481e-ad74-bc3a655900e5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1723 microversion: 2.20 time: 0.157000 Aug 24 08:01:29.415801 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 347/696] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:29 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:30.439398 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-c9be84a8-f1ea-4a72-bc4c-4ae414388065 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:30.440239 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-c9be84a8-f1ea-4a72-bc4c-4ae414388065 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:30.451793 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c9be84a8-f1ea-4a72-bc4c-4ae414388065 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:30.451793 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c9be84a8-f1ea-4a72-bc4c-4ae414388065 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:30.451793 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c9be84a8-f1ea-4a72-bc4c-4ae414388065 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:30.451793 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c9be84a8-f1ea-4a72-bc4c-4ae414388065 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:30.452107 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c9be84a8-f1ea-4a72-bc4c-4ae414388065 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:30.452107 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c9be84a8-f1ea-4a72-bc4c-4ae414388065 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:30.583630 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-c9be84a8-f1ea-4a72-bc4c-4ae414388065 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:30.592003 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-c9be84a8-f1ea-4a72-bc4c-4ae414388065 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:30.593546 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-c9be84a8-f1ea-4a72-bc4c-4ae414388065 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:30.595195 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-c9be84a8-f1ea-4a72-bc4c-4ae414388065 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1723 microversion: 2.20 time: 0.160024 Aug 24 08:01:30.595815 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 350/697] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:30 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:01:31.619501 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-fa75d6a0-94f9-4858-b9ad-0125ea6ef767 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:31.620025 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-fa75d6a0-94f9-4858-b9ad-0125ea6ef767 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:31.626894 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fa75d6a0-94f9-4858-b9ad-0125ea6ef767 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:31.632543 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fa75d6a0-94f9-4858-b9ad-0125ea6ef767 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:31.632543 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fa75d6a0-94f9-4858-b9ad-0125ea6ef767 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:31.632543 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fa75d6a0-94f9-4858-b9ad-0125ea6ef767 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:31.632543 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fa75d6a0-94f9-4858-b9ad-0125ea6ef767 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:31.633270 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fa75d6a0-94f9-4858-b9ad-0125ea6ef767 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:31.851275 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-fa75d6a0-94f9-4858-b9ad-0125ea6ef767 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:31.859436 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-fa75d6a0-94f9-4858-b9ad-0125ea6ef767 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:31.860983 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-fa75d6a0-94f9-4858-b9ad-0125ea6ef767 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:31.862138 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-fa75d6a0-94f9-4858-b9ad-0125ea6ef767 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1723 microversion: 2.20 time: 0.246680 Aug 24 08:01:31.862689 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 348/698] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:31 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:32.885024 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-a379f961-c85e-4cf3-be31-b4892e75975c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:32.886033 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-a379f961-c85e-4cf3-be31-b4892e75975c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:32.892740 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a379f961-c85e-4cf3-be31-b4892e75975c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:32.893217 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a379f961-c85e-4cf3-be31-b4892e75975c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:32.893594 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a379f961-c85e-4cf3-be31-b4892e75975c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:32.894307 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a379f961-c85e-4cf3-be31-b4892e75975c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:32.894752 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a379f961-c85e-4cf3-be31-b4892e75975c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:32.895178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a379f961-c85e-4cf3-be31-b4892e75975c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:33.027074 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a379f961-c85e-4cf3-be31-b4892e75975c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:33.036161 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a379f961-c85e-4cf3-be31-b4892e75975c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:33.037686 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a379f961-c85e-4cf3-be31-b4892e75975c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:33.038831 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-a379f961-c85e-4cf3-be31-b4892e75975c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1723 microversion: 2.20 time: 0.157779 Aug 24 08:01:33.039381 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 351/699] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:32 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:34.061486 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-b0691ab7-a9c8-4ed5-988b-f1f7b6c4f59c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:34.062092 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-b0691ab7-a9c8-4ed5-988b-f1f7b6c4f59c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:34.069319 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b0691ab7-a9c8-4ed5-988b-f1f7b6c4f59c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:34.069801 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b0691ab7-a9c8-4ed5-988b-f1f7b6c4f59c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:34.070235 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b0691ab7-a9c8-4ed5-988b-f1f7b6c4f59c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:34.070925 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b0691ab7-a9c8-4ed5-988b-f1f7b6c4f59c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:34.071377 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b0691ab7-a9c8-4ed5-988b-f1f7b6c4f59c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:34.071800 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b0691ab7-a9c8-4ed5-988b-f1f7b6c4f59c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:34.208408 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-b0691ab7-a9c8-4ed5-988b-f1f7b6c4f59c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:34.216940 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-b0691ab7-a9c8-4ed5-988b-f1f7b6c4f59c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:34.218917 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-b0691ab7-a9c8-4ed5-988b-f1f7b6c4f59c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:34.221200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-b0691ab7-a9c8-4ed5-988b-f1f7b6c4f59c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1723 microversion: 2.20 time: 0.163230 Aug 24 08:01:34.222669 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 349/700] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:34 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:35.245802 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-04429526-9153-41a0-84e3-3ca86fc96965 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:35.246430 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-04429526-9153-41a0-84e3-3ca86fc96965 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:35.252959 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-04429526-9153-41a0-84e3-3ca86fc96965 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:35.253440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-04429526-9153-41a0-84e3-3ca86fc96965 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:35.253877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-04429526-9153-41a0-84e3-3ca86fc96965 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:35.255246 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-04429526-9153-41a0-84e3-3ca86fc96965 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:35.255691 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-04429526-9153-41a0-84e3-3ca86fc96965 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:35.256113 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-04429526-9153-41a0-84e3-3ca86fc96965 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:35.386301 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-04429526-9153-41a0-84e3-3ca86fc96965 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:35.394470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-04429526-9153-41a0-84e3-3ca86fc96965 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:35.396003 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-04429526-9153-41a0-84e3-3ca86fc96965 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:35.397179 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-04429526-9153-41a0-84e3-3ca86fc96965 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1723 microversion: 2.20 time: 0.155457 Aug 24 08:01:35.397731 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 352/701] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:35 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:36.419740 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-cb86c95b-19d1-4f25-8a5c-6a328473c9a7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:36.420339 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-cb86c95b-19d1-4f25-8a5c-6a328473c9a7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:36.427421 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cb86c95b-19d1-4f25-8a5c-6a328473c9a7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:36.427896 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cb86c95b-19d1-4f25-8a5c-6a328473c9a7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:36.428328 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cb86c95b-19d1-4f25-8a5c-6a328473c9a7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:36.429054 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cb86c95b-19d1-4f25-8a5c-6a328473c9a7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:36.429633 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cb86c95b-19d1-4f25-8a5c-6a328473c9a7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:36.430037 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cb86c95b-19d1-4f25-8a5c-6a328473c9a7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:36.566186 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-cb86c95b-19d1-4f25-8a5c-6a328473c9a7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:36.574420 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-cb86c95b-19d1-4f25-8a5c-6a328473c9a7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:36.575928 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-cb86c95b-19d1-4f25-8a5c-6a328473c9a7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:36.577103 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-cb86c95b-19d1-4f25-8a5c-6a328473c9a7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1723 microversion: 2.20 time: 0.161142 Aug 24 08:01:36.577666 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 350/702] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:36 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:37.599859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-a8c1a436-3523-4067-bb21-17cc2ea8186e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:37.600460 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-a8c1a436-3523-4067-bb21-17cc2ea8186e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:37.607076 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a8c1a436-3523-4067-bb21-17cc2ea8186e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:37.607579 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a8c1a436-3523-4067-bb21-17cc2ea8186e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:37.608046 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a8c1a436-3523-4067-bb21-17cc2ea8186e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:37.608773 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a8c1a436-3523-4067-bb21-17cc2ea8186e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:37.609231 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a8c1a436-3523-4067-bb21-17cc2ea8186e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:37.609662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a8c1a436-3523-4067-bb21-17cc2ea8186e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:37.746120 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a8c1a436-3523-4067-bb21-17cc2ea8186e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:37.755081 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a8c1a436-3523-4067-bb21-17cc2ea8186e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:37.756591 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a8c1a436-3523-4067-bb21-17cc2ea8186e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:37.757837 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-a8c1a436-3523-4067-bb21-17cc2ea8186e tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1723 microversion: 2.20 time: 0.161894 Aug 24 08:01:37.758401 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 353/703] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:37 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:38.780317 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-bbab27dd-fa15-4331-984d-03efb4963a9f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:38.780954 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-bbab27dd-fa15-4331-984d-03efb4963a9f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:38.787563 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bbab27dd-fa15-4331-984d-03efb4963a9f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:38.788040 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bbab27dd-fa15-4331-984d-03efb4963a9f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:38.788470 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bbab27dd-fa15-4331-984d-03efb4963a9f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:38.789184 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bbab27dd-fa15-4331-984d-03efb4963a9f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:38.789636 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bbab27dd-fa15-4331-984d-03efb4963a9f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:38.790057 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bbab27dd-fa15-4331-984d-03efb4963a9f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:38.794251 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:38.930738 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-bbab27dd-fa15-4331-984d-03efb4963a9f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:38.938952 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-bbab27dd-fa15-4331-984d-03efb4963a9f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:38.940428 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-bbab27dd-fa15-4331-984d-03efb4963a9f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:38.942138 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-bbab27dd-fa15-4331-984d-03efb4963a9f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1744 microversion: 2.20 time: 0.165228 Aug 24 08:01:38.942833 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 351/704] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:38 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:39.966537 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-7e58fe4b-6edc-48ef-851a-089f9c20144b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:39.967299 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-7e58fe4b-6edc-48ef-851a-089f9c20144b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:39.974354 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7e58fe4b-6edc-48ef-851a-089f9c20144b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:39.974919 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7e58fe4b-6edc-48ef-851a-089f9c20144b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:39.975668 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7e58fe4b-6edc-48ef-851a-089f9c20144b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:39.976435 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7e58fe4b-6edc-48ef-851a-089f9c20144b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:39.977097 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7e58fe4b-6edc-48ef-851a-089f9c20144b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:39.977527 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7e58fe4b-6edc-48ef-851a-089f9c20144b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:40.113715 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7e58fe4b-6edc-48ef-851a-089f9c20144b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:40.122110 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7e58fe4b-6edc-48ef-851a-089f9c20144b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:40.123666 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7e58fe4b-6edc-48ef-851a-089f9c20144b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:40.124922 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-7e58fe4b-6edc-48ef-851a-089f9c20144b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1744 microversion: 2.20 time: 0.162301 Aug 24 08:01:40.125471 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 354/705] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:39 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:41.148440 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-dab25444-fa44-4eb5-86ab-cee7d0321234 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:41.151259 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-dab25444-fa44-4eb5-86ab-cee7d0321234 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:41.161026 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dab25444-fa44-4eb5-86ab-cee7d0321234 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:41.161520 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dab25444-fa44-4eb5-86ab-cee7d0321234 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:41.162170 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dab25444-fa44-4eb5-86ab-cee7d0321234 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:41.163062 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dab25444-fa44-4eb5-86ab-cee7d0321234 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:41.163511 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dab25444-fa44-4eb5-86ab-cee7d0321234 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:41.164098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dab25444-fa44-4eb5-86ab-cee7d0321234 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:41.377763 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-dab25444-fa44-4eb5-86ab-cee7d0321234 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:41.391724 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-dab25444-fa44-4eb5-86ab-cee7d0321234 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:41.399169 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-dab25444-fa44-4eb5-86ab-cee7d0321234 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:41.400872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-dab25444-fa44-4eb5-86ab-cee7d0321234 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1739 microversion: 2.20 time: 0.256575 Aug 24 08:01:41.401640 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 352/706] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:41 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1739 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:42.445859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-90ef1cf2-fb54-400d-a11f-e3ce2aece103 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:42.445859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-90ef1cf2-fb54-400d-a11f-e3ce2aece103 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:42.445859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-90ef1cf2-fb54-400d-a11f-e3ce2aece103 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:42.445859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-90ef1cf2-fb54-400d-a11f-e3ce2aece103 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:42.446632 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-90ef1cf2-fb54-400d-a11f-e3ce2aece103 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:42.446632 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-90ef1cf2-fb54-400d-a11f-e3ce2aece103 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:42.446632 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-90ef1cf2-fb54-400d-a11f-e3ce2aece103 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:42.446632 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-90ef1cf2-fb54-400d-a11f-e3ce2aece103 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:42.655349 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-90ef1cf2-fb54-400d-a11f-e3ce2aece103 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:42.659397 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=100 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:42.666301 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-90ef1cf2-fb54-400d-a11f-e3ce2aece103 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:42.720265 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-90ef1cf2-fb54-400d-a11f-e3ce2aece103 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:42.720265 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-90ef1cf2-fb54-400d-a11f-e3ce2aece103 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1739 microversion: 2.20 time: 0.262045 Aug 24 08:01:42.720265 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 355/707] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:42 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1739 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:42.965019 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-ed7bb355-b29b-4d1a-ad61-6c6dd103cf7b req-e0b30247-ae75-4e1b-a3f8-ae29e58d795d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "771d249a-e50d-4848-b6ab-cb76685964d7", "name": "network-vif-plugged", "status": "completed", "tag": "f4073395-cdc8-42de-89a0-3e684efbce28"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:01:42.970209 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:42.976484 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-ed7bb355-b29b-4d1a-ad61-6c6dd103cf7b req-e0b30247-ae75-4e1b-a3f8-ae29e58d795d service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:42.977193 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-ed7bb355-b29b-4d1a-ad61-6c6dd103cf7b req-e0b30247-ae75-4e1b-a3f8-ae29e58d795d service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:42.978569 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-ed7bb355-b29b-4d1a-ad61-6c6dd103cf7b req-e0b30247-ae75-4e1b-a3f8-ae29e58d795d service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:42.991817 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-ed7bb355-b29b-4d1a-ad61-6c6dd103cf7b req-e0b30247-ae75-4e1b-a3f8-ae29e58d795d service nova] Creating event network-vif-plugged:f4073395-cdc8-42de-89a0-3e684efbce28 for instance 771d249a-e50d-4848-b6ab-cb76685964d7 on hv-cinder-85427 Aug 24 08:01:42.998739 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-ed7bb355-b29b-4d1a-ad61-6c6dd103cf7b req-e0b30247-ae75-4e1b-a3f8-ae29e58d795d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.343471 Aug 24 08:01:42.999615 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 353/708] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:01:43.716152 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-18c67b59-9211-4040-bc97-50198af86462 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:43.716783 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-18c67b59-9211-4040-bc97-50198af86462 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:43.726618 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=54 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:43.728225 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-18c67b59-9211-4040-bc97-50198af86462 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:43.728743 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-18c67b59-9211-4040-bc97-50198af86462 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:43.729567 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-18c67b59-9211-4040-bc97-50198af86462 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:43.730529 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-18c67b59-9211-4040-bc97-50198af86462 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:43.731329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-18c67b59-9211-4040-bc97-50198af86462 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:43.731953 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-18c67b59-9211-4040-bc97-50198af86462 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:44.165520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-18c67b59-9211-4040-bc97-50198af86462 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:44.165520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-18c67b59-9211-4040-bc97-50198af86462 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:44.165798 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-18c67b59-9211-4040-bc97-50198af86462 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:44.165798 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-18c67b59-9211-4040-bc97-50198af86462 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1739 microversion: 2.20 time: 0.449040 Aug 24 08:01:44.165798 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 356/709] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:43 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1739 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:45.191819 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-4f5b3b02-2616-48c4-9882-ab37cc829296 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:45.192535 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-4f5b3b02-2616-48c4-9882-ab37cc829296 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:45.220295 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4f5b3b02-2616-48c4-9882-ab37cc829296 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:45.221802 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4f5b3b02-2616-48c4-9882-ab37cc829296 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:45.222672 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4f5b3b02-2616-48c4-9882-ab37cc829296 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:45.224381 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4f5b3b02-2616-48c4-9882-ab37cc829296 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:45.225026 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4f5b3b02-2616-48c4-9882-ab37cc829296 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:45.225624 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4f5b3b02-2616-48c4-9882-ab37cc829296 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:45.421554 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-4f5b3b02-2616-48c4-9882-ab37cc829296 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:45.431701 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-4f5b3b02-2616-48c4-9882-ab37cc829296 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:45.433433 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-4f5b3b02-2616-48c4-9882-ab37cc829296 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:45.434851 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-4f5b3b02-2616-48c4-9882-ab37cc829296 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1739 microversion: 2.20 time: 0.252300 Aug 24 08:01:45.435927 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 354/710] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:45 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:46.463909 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-a79f645f-8d55-4cf3-b4bc-6424f732d789 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:46.465256 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-a79f645f-8d55-4cf3-b4bc-6424f732d789 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:46.472391 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a79f645f-8d55-4cf3-b4bc-6424f732d789 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:46.473648 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a79f645f-8d55-4cf3-b4bc-6424f732d789 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:46.474248 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a79f645f-8d55-4cf3-b4bc-6424f732d789 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:46.474946 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a79f645f-8d55-4cf3-b4bc-6424f732d789 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:46.475395 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a79f645f-8d55-4cf3-b4bc-6424f732d789 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:46.475813 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a79f645f-8d55-4cf3-b4bc-6424f732d789 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:46.639816 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a79f645f-8d55-4cf3-b4bc-6424f732d789 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:46.651627 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a79f645f-8d55-4cf3-b4bc-6424f732d789 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:46.653582 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a79f645f-8d55-4cf3-b4bc-6424f732d789 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:46.654920 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-a79f645f-8d55-4cf3-b4bc-6424f732d789 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1739 microversion: 2.20 time: 0.195027 Aug 24 08:01:46.655864 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 357/711] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:46 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:01:47.680446 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-230a9285-6fcc-47a1-9a15-c8469eea6d92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:47.684423 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-230a9285-6fcc-47a1-9a15-c8469eea6d92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:47.687838 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-230a9285-6fcc-47a1-9a15-c8469eea6d92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:47.688324 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-230a9285-6fcc-47a1-9a15-c8469eea6d92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:47.688794 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-230a9285-6fcc-47a1-9a15-c8469eea6d92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:47.689491 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-230a9285-6fcc-47a1-9a15-c8469eea6d92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:47.689987 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-230a9285-6fcc-47a1-9a15-c8469eea6d92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:47.690436 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-230a9285-6fcc-47a1-9a15-c8469eea6d92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:47.862090 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-230a9285-6fcc-47a1-9a15-c8469eea6d92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:47.872192 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-230a9285-6fcc-47a1-9a15-c8469eea6d92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:47.876325 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-230a9285-6fcc-47a1-9a15-c8469eea6d92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:47.876325 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-230a9285-6fcc-47a1-9a15-c8469eea6d92 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1739 microversion: 2.20 time: 0.199271 Aug 24 08:01:47.876325 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 355/712] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:47 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:48.899423 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-d70137a1-74c1-4348-bd00-7158716b729a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:48.900052 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-d70137a1-74c1-4348-bd00-7158716b729a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:48.907104 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d70137a1-74c1-4348-bd00-7158716b729a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:48.907780 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d70137a1-74c1-4348-bd00-7158716b729a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:48.908215 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d70137a1-74c1-4348-bd00-7158716b729a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:48.908943 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d70137a1-74c1-4348-bd00-7158716b729a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:48.909624 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d70137a1-74c1-4348-bd00-7158716b729a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:48.910337 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d70137a1-74c1-4348-bd00-7158716b729a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:49.065587 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-d70137a1-74c1-4348-bd00-7158716b729a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:49.074874 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-d70137a1-74c1-4348-bd00-7158716b729a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:49.079352 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-d70137a1-74c1-4348-bd00-7158716b729a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:49.080144 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-d70137a1-74c1-4348-bd00-7158716b729a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1739 microversion: 2.20 time: 0.185004 Aug 24 08:01:49.080733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 358/713] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:48 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:50.106272 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-8c1af6f5-c2e4-4615-abae-9231f16c50b5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:50.107609 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-8c1af6f5-c2e4-4615-abae-9231f16c50b5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:50.117721 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8c1af6f5-c2e4-4615-abae-9231f16c50b5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:50.118446 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8c1af6f5-c2e4-4615-abae-9231f16c50b5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:50.119102 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8c1af6f5-c2e4-4615-abae-9231f16c50b5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:50.120339 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8c1af6f5-c2e4-4615-abae-9231f16c50b5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:50.121489 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8c1af6f5-c2e4-4615-abae-9231f16c50b5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:50.123488 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8c1af6f5-c2e4-4615-abae-9231f16c50b5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:50.279752 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-8c1af6f5-c2e4-4615-abae-9231f16c50b5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:50.291573 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-8c1af6f5-c2e4-4615-abae-9231f16c50b5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:50.294125 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-8c1af6f5-c2e4-4615-abae-9231f16c50b5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:50.295992 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-8c1af6f5-c2e4-4615-abae-9231f16c50b5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1739 microversion: 2.20 time: 0.195773 Aug 24 08:01:50.296861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 356/714] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:50 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:51.323463 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-db8486d6-938f-4c93-9579-7376ce979c6a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:51.326309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-db8486d6-938f-4c93-9579-7376ce979c6a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:51.350721 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-db8486d6-938f-4c93-9579-7376ce979c6a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:51.351147 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-db8486d6-938f-4c93-9579-7376ce979c6a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:51.351615 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-db8486d6-938f-4c93-9579-7376ce979c6a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:51.352328 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-db8486d6-938f-4c93-9579-7376ce979c6a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:51.352810 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-db8486d6-938f-4c93-9579-7376ce979c6a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:51.353712 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-db8486d6-938f-4c93-9579-7376ce979c6a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:51.533620 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-db8486d6-938f-4c93-9579-7376ce979c6a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:51.545766 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-db8486d6-938f-4c93-9579-7376ce979c6a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:51.547685 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-db8486d6-938f-4c93-9579-7376ce979c6a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:51.549219 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-db8486d6-938f-4c93-9579-7376ce979c6a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1739 microversion: 2.20 time: 0.230045 Aug 24 08:01:51.549773 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 359/715] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:51 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1739 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:52.572504 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-241d55ef-6892-47e3-aca4-21aea6557aa5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:52.573248 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-241d55ef-6892-47e3-aca4-21aea6557aa5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:52.580495 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-241d55ef-6892-47e3-aca4-21aea6557aa5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:52.580903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-241d55ef-6892-47e3-aca4-21aea6557aa5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:52.581346 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-241d55ef-6892-47e3-aca4-21aea6557aa5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:52.582575 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-241d55ef-6892-47e3-aca4-21aea6557aa5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:52.583013 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-241d55ef-6892-47e3-aca4-21aea6557aa5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:52.583479 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-241d55ef-6892-47e3-aca4-21aea6557aa5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:52.722364 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-241d55ef-6892-47e3-aca4-21aea6557aa5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:52.731190 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-241d55ef-6892-47e3-aca4-21aea6557aa5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:52.732736 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-241d55ef-6892-47e3-aca4-21aea6557aa5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:52.733883 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-241d55ef-6892-47e3-aca4-21aea6557aa5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1739 microversion: 2.20 time: 0.165467 Aug 24 08:01:52.734468 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 357/716] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:52 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:53.756536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-0e68c7d5-bfe5-4baf-ba63-7b02b1b7e0dc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:53.757175 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-0e68c7d5-bfe5-4baf-ba63-7b02b1b7e0dc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:53.763678 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0e68c7d5-bfe5-4baf-ba63-7b02b1b7e0dc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:53.764162 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0e68c7d5-bfe5-4baf-ba63-7b02b1b7e0dc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:53.764597 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0e68c7d5-bfe5-4baf-ba63-7b02b1b7e0dc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:53.765381 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0e68c7d5-bfe5-4baf-ba63-7b02b1b7e0dc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:53.765814 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0e68c7d5-bfe5-4baf-ba63-7b02b1b7e0dc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:53.770817 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0e68c7d5-bfe5-4baf-ba63-7b02b1b7e0dc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:53.896300 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-0e68c7d5-bfe5-4baf-ba63-7b02b1b7e0dc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:53.904829 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-0e68c7d5-bfe5-4baf-ba63-7b02b1b7e0dc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:53.906794 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-0e68c7d5-bfe5-4baf-ba63-7b02b1b7e0dc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:53.907939 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-0e68c7d5-bfe5-4baf-ba63-7b02b1b7e0dc tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1721 microversion: 2.20 time: 0.156080 Aug 24 08:01:53.908728 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 360/717] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:53 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:54.933526 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-623d55eb-37c3-477c-a7ca-20a2e2d5c683 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:54.934150 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-623d55eb-37c3-477c-a7ca-20a2e2d5c683 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:54.940873 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-623d55eb-37c3-477c-a7ca-20a2e2d5c683 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:54.942049 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-623d55eb-37c3-477c-a7ca-20a2e2d5c683 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:54.942490 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-623d55eb-37c3-477c-a7ca-20a2e2d5c683 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:54.943188 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-623d55eb-37c3-477c-a7ca-20a2e2d5c683 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:54.943646 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-623d55eb-37c3-477c-a7ca-20a2e2d5c683 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:54.944073 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-623d55eb-37c3-477c-a7ca-20a2e2d5c683 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:55.078983 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-623d55eb-37c3-477c-a7ca-20a2e2d5c683 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:55.089768 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-623d55eb-37c3-477c-a7ca-20a2e2d5c683 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:55.091303 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-623d55eb-37c3-477c-a7ca-20a2e2d5c683 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:55.092481 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-623d55eb-37c3-477c-a7ca-20a2e2d5c683 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1721 microversion: 2.20 time: 0.162927 Aug 24 08:01:55.093070 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 358/718] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:54 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:56.121915 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-7c660f01-6d9a-44f0-a831-de40fb1d7654 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:56.122524 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-7c660f01-6d9a-44f0-a831-de40fb1d7654 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:56.129560 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7c660f01-6d9a-44f0-a831-de40fb1d7654 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:56.130045 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7c660f01-6d9a-44f0-a831-de40fb1d7654 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:56.130475 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7c660f01-6d9a-44f0-a831-de40fb1d7654 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:56.131243 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7c660f01-6d9a-44f0-a831-de40fb1d7654 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:56.131712 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7c660f01-6d9a-44f0-a831-de40fb1d7654 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:56.132134 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7c660f01-6d9a-44f0-a831-de40fb1d7654 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:56.266527 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7c660f01-6d9a-44f0-a831-de40fb1d7654 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:56.274974 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7c660f01-6d9a-44f0-a831-de40fb1d7654 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:56.276520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7c660f01-6d9a-44f0-a831-de40fb1d7654 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:56.277697 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-7c660f01-6d9a-44f0-a831-de40fb1d7654 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1664 microversion: 2.20 time: 0.159866 Aug 24 08:01:56.278248 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 361/719] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:56 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1664 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:01:56.300054 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-52016f9e-f400-4b14-bd34-d292a339e150 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33b3cf21-5bc9-413b-85dd-d01ddc5470d1"}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:01:56.306415 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-52016f9e-f400-4b14-bd34-d292a339e150 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:56.310210 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-52016f9e-f400-4b14-bd34-d292a339e150 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:56.310782 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-52016f9e-f400-4b14-bd34-d292a339e150 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:56.311145 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-52016f9e-f400-4b14-bd34-d292a339e150 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:56.312069 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-52016f9e-f400-4b14-bd34-d292a339e150 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:56.312624 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-52016f9e-f400-4b14-bd34-d292a339e150 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:56.313078 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-52016f9e-f400-4b14-bd34-d292a339e150 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:56.645603 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-e6dfa984-2fa5-4fcd-ac87-d7932ca49217 req-305969fa-3c4b-42b1-a4ff-31a9a01e6cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "771d249a-e50d-4848-b6ab-cb76685964d7", "name": "network-vif-unplugged", "status": "completed", "tag": "f4073395-cdc8-42de-89a0-3e684efbce28"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:01:56.655661 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-e6dfa984-2fa5-4fcd-ac87-d7932ca49217 req-305969fa-3c4b-42b1-a4ff-31a9a01e6cd4 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:56.664152 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-e6dfa984-2fa5-4fcd-ac87-d7932ca49217 req-305969fa-3c4b-42b1-a4ff-31a9a01e6cd4 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:56.664152 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-e6dfa984-2fa5-4fcd-ac87-d7932ca49217 req-305969fa-3c4b-42b1-a4ff-31a9a01e6cd4 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:56.667774 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.compute.server_external_events [req-e6dfa984-2fa5-4fcd-ac87-d7932ca49217 req-305969fa-3c4b-42b1-a4ff-31a9a01e6cd4 service nova] Unable to find a host for instance 771d249a-e50d-4848-b6ab-cb76685964d7. Dropping event network-vif-unplugged {{(pid=127589) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 08:01:56.668748 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-e6dfa984-2fa5-4fcd-ac87-d7932ca49217 req-305969fa-3c4b-42b1-a4ff-31a9a01e6cd4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027711 Aug 24 08:01:56.669311 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 362/720] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 24 08:01:57.362367 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-52016f9e-f400-4b14-bd34-d292a339e150 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "POST /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.066253 Aug 24 08:01:57.362974 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 359/721] 10.222.0.72 () {62 vars in 1364 bytes} [Wed Aug 24 08:01:56 2022] POST /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7/os-volume_attachments => generated 188 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:01:57.490993 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-2ee91881-2e3b-4fbc-8273-871e9fad2774 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:57.491519 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-2ee91881-2e3b-4fbc-8273-871e9fad2774 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:57.497930 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2ee91881-2e3b-4fbc-8273-871e9fad2774 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:57.498416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2ee91881-2e3b-4fbc-8273-871e9fad2774 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:57.498856 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2ee91881-2e3b-4fbc-8273-871e9fad2774 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:57.499560 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2ee91881-2e3b-4fbc-8273-871e9fad2774 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:57.500018 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2ee91881-2e3b-4fbc-8273-871e9fad2774 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:57.500445 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2ee91881-2e3b-4fbc-8273-871e9fad2774 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:58.097785 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-2ee91881-2e3b-4fbc-8273-871e9fad2774 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "DELETE /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7/os-volume_attachments/33b3cf21-5bc9-413b-85dd-d01ddc5470d1" status: 202 len: 0 microversion: 2.20 time: 0.610173 Aug 24 08:01:58.098385 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 363/722] 10.222.0.72 () {60 vars in 1457 bytes} [Wed Aug 24 08:01:57 2022] DELETE /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7/os-volume_attachments/33b3cf21-5bc9-413b-85dd-d01ddc5470d1 => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:01:58.160988 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-8cbac72a-aa42-436a-b5b8-db50857cb02b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:01:58.161590 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-8cbac72a-aa42-436a-b5b8-db50857cb02b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:58.167776 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8cbac72a-aa42-436a-b5b8-db50857cb02b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:58.168258 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8cbac72a-aa42-436a-b5b8-db50857cb02b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:58.168728 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8cbac72a-aa42-436a-b5b8-db50857cb02b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:58.169432 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8cbac72a-aa42-436a-b5b8-db50857cb02b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:58.169881 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8cbac72a-aa42-436a-b5b8-db50857cb02b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:58.170309 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8cbac72a-aa42-436a-b5b8-db50857cb02b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:58.201855 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-8cbac72a-aa42-436a-b5b8-db50857cb02b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127590) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 08:01:58.511850 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-8cbac72a-aa42-436a-b5b8-db50857cb02b tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "POST /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7/action" status: 202 len: 0 microversion: 2.20 time: 0.355491 Aug 24 08:01:58.512532 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 360/723] 10.222.0.72 () {62 vars in 1319 bytes} [Wed Aug 24 08:01:58 2022] POST /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 08:01:58.521259 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-5e14bc56-2371-4918-a0b3-57f03c50bc7d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:58.521896 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-5e14bc56-2371-4918-a0b3-57f03c50bc7d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:58.529092 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5e14bc56-2371-4918-a0b3-57f03c50bc7d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:58.529579 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5e14bc56-2371-4918-a0b3-57f03c50bc7d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:58.530190 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5e14bc56-2371-4918-a0b3-57f03c50bc7d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:58.530917 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5e14bc56-2371-4918-a0b3-57f03c50bc7d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:58.531642 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5e14bc56-2371-4918-a0b3-57f03c50bc7d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:58.532067 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5e14bc56-2371-4918-a0b3-57f03c50bc7d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:58.666248 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-5e14bc56-2371-4918-a0b3-57f03c50bc7d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:58.674505 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-5e14bc56-2371-4918-a0b3-57f03c50bc7d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:58.676158 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-5e14bc56-2371-4918-a0b3-57f03c50bc7d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:58.677377 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-5e14bc56-2371-4918-a0b3-57f03c50bc7d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1672 microversion: 2.20 time: 0.160715 Aug 24 08:01:58.677924 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 364/724] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:58 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:01:59.699907 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-4658ec63-c846-43f9-9249-33171c2a1ab2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:01:59.700609 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-4658ec63-c846-43f9-9249-33171c2a1ab2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:01:59.708129 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4658ec63-c846-43f9-9249-33171c2a1ab2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:59.708621 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4658ec63-c846-43f9-9249-33171c2a1ab2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:59.709097 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4658ec63-c846-43f9-9249-33171c2a1ab2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:59.716888 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4658ec63-c846-43f9-9249-33171c2a1ab2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:01:59.716888 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4658ec63-c846-43f9-9249-33171c2a1ab2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:01:59.716888 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4658ec63-c846-43f9-9249-33171c2a1ab2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:01:59.864327 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-4658ec63-c846-43f9-9249-33171c2a1ab2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:59.873176 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-4658ec63-c846-43f9-9249-33171c2a1ab2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:59.874656 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-4658ec63-c846-43f9-9249-33171c2a1ab2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:01:59.875791 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-4658ec63-c846-43f9-9249-33171c2a1ab2 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1672 microversion: 2.20 time: 0.180241 Aug 24 08:01:59.876343 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 361/725] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:01:59 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1672 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:02:00.898394 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-61ea1061-c299-433f-8733-0749208fd6d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:00.899010 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-61ea1061-c299-433f-8733-0749208fd6d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:00.905435 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-61ea1061-c299-433f-8733-0749208fd6d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:00.905923 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-61ea1061-c299-433f-8733-0749208fd6d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:00.906630 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-61ea1061-c299-433f-8733-0749208fd6d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:00.907332 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-61ea1061-c299-433f-8733-0749208fd6d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:00.907788 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-61ea1061-c299-433f-8733-0749208fd6d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:00.908221 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-61ea1061-c299-433f-8733-0749208fd6d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:01.053157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-61ea1061-c299-433f-8733-0749208fd6d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:01.061417 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-61ea1061-c299-433f-8733-0749208fd6d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:01.062925 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-61ea1061-c299-433f-8733-0749208fd6d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:01.064074 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-61ea1061-c299-433f-8733-0749208fd6d4 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1730 microversion: 2.20 time: 0.169631 Aug 24 08:02:01.064622 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 365/726] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:02:00 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:02:02.092019 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-0ffd1b92-d7dd-42e8-8289-005dcd8a6927 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:02.093407 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-0ffd1b92-d7dd-42e8-8289-005dcd8a6927 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:02.102721 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0ffd1b92-d7dd-42e8-8289-005dcd8a6927 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:02.103633 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0ffd1b92-d7dd-42e8-8289-005dcd8a6927 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:02.108633 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0ffd1b92-d7dd-42e8-8289-005dcd8a6927 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:02.108633 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0ffd1b92-d7dd-42e8-8289-005dcd8a6927 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:02.108633 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0ffd1b92-d7dd-42e8-8289-005dcd8a6927 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:02.109057 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0ffd1b92-d7dd-42e8-8289-005dcd8a6927 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:02.279535 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-0ffd1b92-d7dd-42e8-8289-005dcd8a6927 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:02.291143 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-0ffd1b92-d7dd-42e8-8289-005dcd8a6927 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:02.292921 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-0ffd1b92-d7dd-42e8-8289-005dcd8a6927 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:02.294073 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-0ffd1b92-d7dd-42e8-8289-005dcd8a6927 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1730 microversion: 2.20 time: 0.206485 Aug 24 08:02:02.302432 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 362/727] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:02:02 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:02:03.325459 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-62a28f40-df46-4643-80c2-0d22c343a656 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:03.326540 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-62a28f40-df46-4643-80c2-0d22c343a656 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:03.338261 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-62a28f40-df46-4643-80c2-0d22c343a656 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:03.339656 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-62a28f40-df46-4643-80c2-0d22c343a656 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:03.340937 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-62a28f40-df46-4643-80c2-0d22c343a656 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:03.342428 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-62a28f40-df46-4643-80c2-0d22c343a656 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:03.343504 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-62a28f40-df46-4643-80c2-0d22c343a656 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:03.344217 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-62a28f40-df46-4643-80c2-0d22c343a656 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:03.564209 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-62a28f40-df46-4643-80c2-0d22c343a656 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:03.584077 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-62a28f40-df46-4643-80c2-0d22c343a656 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:03.586936 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-62a28f40-df46-4643-80c2-0d22c343a656 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:03.594595 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-62a28f40-df46-4643-80c2-0d22c343a656 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1730 microversion: 2.20 time: 0.272774 Aug 24 08:02:03.594595 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 366/728] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:02:03 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1730 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:02:04.211967 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-377e34e7-23a0-4202-abec-3b536ce8cc6a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:02:04.212505 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-377e34e7-23a0-4202-abec-3b536ce8cc6a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:04.219028 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-377e34e7-23a0-4202-abec-3b536ce8cc6a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:04.219592 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-377e34e7-23a0-4202-abec-3b536ce8cc6a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:04.220085 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-377e34e7-23a0-4202-abec-3b536ce8cc6a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:04.221280 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-377e34e7-23a0-4202-abec-3b536ce8cc6a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:04.221667 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-377e34e7-23a0-4202-abec-3b536ce8cc6a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:04.222637 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-377e34e7-23a0-4202-abec-3b536ce8cc6a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:04.249505 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.objects.instance [None req-377e34e7-23a0-4202-abec-3b536ce8cc6a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lazy-loading 'flavor' on Instance uuid 3ce799f4-91d9-4521-af5d-63757a11823c {{(pid=127590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:02:04.389555 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:04.577349 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-377e34e7-23a0-4202-abec-3b536ce8cc6a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "POST /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c/action" status: 202 len: 0 microversion: 2.1 time: 0.369868 Aug 24 08:02:04.578277 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 363/729] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 24 08:02:04 2022] POST /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:02:04.587655 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-a503196f-38d1-4601-9e8b-835c90413c7f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:04.588317 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-a503196f-38d1-4601-9e8b-835c90413c7f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:04.598505 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a503196f-38d1-4601-9e8b-835c90413c7f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:04.604451 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a503196f-38d1-4601-9e8b-835c90413c7f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:04.610309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a503196f-38d1-4601-9e8b-835c90413c7f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:04.610309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a503196f-38d1-4601-9e8b-835c90413c7f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:04.610309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a503196f-38d1-4601-9e8b-835c90413c7f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:04.610309 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a503196f-38d1-4601-9e8b-835c90413c7f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:04.618031 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-e6390a89-b4e1-43cb-9202-488d3a41914a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:04.619111 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-e6390a89-b4e1-43cb-9202-488d3a41914a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:04.627654 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e6390a89-b4e1-43cb-9202-488d3a41914a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:04.628452 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e6390a89-b4e1-43cb-9202-488d3a41914a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:04.629026 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e6390a89-b4e1-43cb-9202-488d3a41914a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:04.629845 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e6390a89-b4e1-43cb-9202-488d3a41914a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:04.630467 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e6390a89-b4e1-43cb-9202-488d3a41914a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:04.630988 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e6390a89-b4e1-43cb-9202-488d3a41914a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:04.817056 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a503196f-38d1-4601-9e8b-835c90413c7f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:04.827810 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-a503196f-38d1-4601-9e8b-835c90413c7f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1569 microversion: 2.1 time: 0.244106 Aug 24 08:02:04.828393 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 367/730] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:04 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1569 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:04.828701 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-e6390a89-b4e1-43cb-9202-488d3a41914a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:04.838644 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-e6390a89-b4e1-43cb-9202-488d3a41914a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:04.840290 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-e6390a89-b4e1-43cb-9202-488d3a41914a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:04.841775 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-e6390a89-b4e1-43cb-9202-488d3a41914a tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1730 microversion: 2.20 time: 0.228716 Aug 24 08:02:04.844684 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 364/731] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:02:04 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1730 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:02:05.250248 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-09adf6bb-e56c-442d-916e-c1dafc66b54d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-988986265"}} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:02:05.251141 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-09adf6bb-e56c-442d-916e-c1dafc66b54d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:05.259384 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-09adf6bb-e56c-442d-916e-c1dafc66b54d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:05.260232 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-09adf6bb-e56c-442d-916e-c1dafc66b54d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:05.260947 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-09adf6bb-e56c-442d-916e-c1dafc66b54d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:05.261907 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-09adf6bb-e56c-442d-916e-c1dafc66b54d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:05.262965 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-09adf6bb-e56c-442d-916e-c1dafc66b54d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:05.263492 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-09adf6bb-e56c-442d-916e-c1dafc66b54d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:05.445178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.network.security_group_api [None req-09adf6bb-e56c-442d-916e-c1dafc66b54d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Removing security group 7082845b-6c67-4ad1-8150-cce2528ae451 from port f9f1b354-6f60-423b-8ee3-6fff02486c95 Aug 24 08:02:05.852554 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-bfd8b7d9-3758-4a9e-a2d0-a2eba84638e9 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:05.853578 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-bfd8b7d9-3758-4a9e-a2d0-a2eba84638e9 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:05.863390 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bfd8b7d9-3758-4a9e-a2d0-a2eba84638e9 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:05.863973 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bfd8b7d9-3758-4a9e-a2d0-a2eba84638e9 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:05.864514 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bfd8b7d9-3758-4a9e-a2d0-a2eba84638e9 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:05.865311 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bfd8b7d9-3758-4a9e-a2d0-a2eba84638e9 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:05.865855 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bfd8b7d9-3758-4a9e-a2d0-a2eba84638e9 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:05.866364 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bfd8b7d9-3758-4a9e-a2d0-a2eba84638e9 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:05.934955 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-09adf6bb-e56c-442d-916e-c1dafc66b54d tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "POST /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68/action" status: 202 len: 0 microversion: 2.1 time: 0.689288 Aug 24 08:02:05.936293 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 368/732] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 24 08:02:05 2022] POST /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68/action => generated 0 bytes in 692 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:02:05.944129 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-0991c618-5450-4713-8338-59d7500b0073 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:05.944966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-0991c618-5450-4713-8338-59d7500b0073 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:05.960059 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0991c618-5450-4713-8338-59d7500b0073 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:05.962095 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0991c618-5450-4713-8338-59d7500b0073 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:05.964954 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0991c618-5450-4713-8338-59d7500b0073 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:05.966445 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0991c618-5450-4713-8338-59d7500b0073 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:05.967274 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0991c618-5450-4713-8338-59d7500b0073 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:05.968153 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0991c618-5450-4713-8338-59d7500b0073 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:06.239387 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-bfd8b7d9-3758-4a9e-a2d0-a2eba84638e9 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:06.268012 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-bfd8b7d9-3758-4a9e-a2d0-a2eba84638e9 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1569 microversion: 2.1 time: 0.421256 Aug 24 08:02:06.271883 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 365/733] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:05 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1569 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:02:06.291211 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-80c9121f-a961-4523-9e30-3be60e03f3ba req-d29f7cbc-cd03-40c6-8459-4b1fcc1025c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86d751e5-15c5-4cbb-a9af-711aab6bee68", "tag": "f9f1b354-6f60-423b-8ee3-6fff02486c95"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:02:06.323739 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-0991c618-5450-4713-8338-59d7500b0073 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:06.324069 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-80c9121f-a961-4523-9e30-3be60e03f3ba req-d29f7cbc-cd03-40c6-8459-4b1fcc1025c0 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:06.326147 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-80c9121f-a961-4523-9e30-3be60e03f3ba req-d29f7cbc-cd03-40c6-8459-4b1fcc1025c0 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:06.327995 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-80c9121f-a961-4523-9e30-3be60e03f3ba req-d29f7cbc-cd03-40c6-8459-4b1fcc1025c0 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:06.338038 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-0991c618-5450-4713-8338-59d7500b0073 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:06.358879 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-0991c618-5450-4713-8338-59d7500b0073 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:06.358879 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-0991c618-5450-4713-8338-59d7500b0073 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1730 microversion: 2.20 time: 0.403429 Aug 24 08:02:06.360880 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 369/734] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:02:05 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1730 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:02:06.381757 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-80c9121f-a961-4523-9e30-3be60e03f3ba req-d29f7cbc-cd03-40c6-8459-4b1fcc1025c0 service nova] Creating event network-changed:f9f1b354-6f60-423b-8ee3-6fff02486c95 for instance 86d751e5-15c5-4cbb-a9af-711aab6bee68 on hv-cinder-85427 Aug 24 08:02:06.390712 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-80c9121f-a961-4523-9e30-3be60e03f3ba req-d29f7cbc-cd03-40c6-8459-4b1fcc1025c0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114368 Aug 24 08:02:06.394814 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 366/735] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:02:07.292642 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-cad82e67-b20e-4a36-a44f-308067e3ce28 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:07.293375 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-cad82e67-b20e-4a36-a44f-308067e3ce28 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:07.299979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cad82e67-b20e-4a36-a44f-308067e3ce28 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:07.300411 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cad82e67-b20e-4a36-a44f-308067e3ce28 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:07.300872 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cad82e67-b20e-4a36-a44f-308067e3ce28 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:07.301573 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cad82e67-b20e-4a36-a44f-308067e3ce28 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:07.302022 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cad82e67-b20e-4a36-a44f-308067e3ce28 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:07.302630 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cad82e67-b20e-4a36-a44f-308067e3ce28 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:07.368198 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-c8ed4ed0-edfb-4fde-b3fc-394940375336 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:07.369694 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-c8ed4ed0-edfb-4fde-b3fc-394940375336 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:07.382629 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c8ed4ed0-edfb-4fde-b3fc-394940375336 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:07.436048 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c8ed4ed0-edfb-4fde-b3fc-394940375336 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:07.436048 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c8ed4ed0-edfb-4fde-b3fc-394940375336 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:07.436048 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c8ed4ed0-edfb-4fde-b3fc-394940375336 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:07.436048 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c8ed4ed0-edfb-4fde-b3fc-394940375336 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:07.436411 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c8ed4ed0-edfb-4fde-b3fc-394940375336 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:07.487374 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-cad82e67-b20e-4a36-a44f-308067e3ce28 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:07.514263 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-cad82e67-b20e-4a36-a44f-308067e3ce28 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1569 microversion: 2.1 time: 0.225216 Aug 24 08:02:07.521718 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 370/736] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:07 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1569 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:07.608383 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-c8ed4ed0-edfb-4fde-b3fc-394940375336 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:07.611224 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-c8ed4ed0-edfb-4fde-b3fc-394940375336 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:07.613565 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-c8ed4ed0-edfb-4fde-b3fc-394940375336 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:07.614821 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-c8ed4ed0-edfb-4fde-b3fc-394940375336 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1730 microversion: 2.20 time: 0.251257 Aug 24 08:02:07.628832 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 367/737] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:02:07 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1730 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:02:08.485520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-5c6bcf23-077d-4377-a345-71a8eda2eaf5 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:08.486093 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-5c6bcf23-077d-4377-a345-71a8eda2eaf5 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:08.490995 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-aa3c1fe5-7b8b-4c9a-aba0-9fa6073fb6d2 req-43f31e88-bde9-4fad-9965-39c30402d985 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86d751e5-15c5-4cbb-a9af-711aab6bee68", "tag": "f9f1b354-6f60-423b-8ee3-6fff02486c95"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:02:08.502000 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c6bcf23-077d-4377-a345-71a8eda2eaf5 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:08.520098 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c6bcf23-077d-4377-a345-71a8eda2eaf5 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:08.520590 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c6bcf23-077d-4377-a345-71a8eda2eaf5 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:08.521377 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c6bcf23-077d-4377-a345-71a8eda2eaf5 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:08.525272 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-aa3c1fe5-7b8b-4c9a-aba0-9fa6073fb6d2 req-43f31e88-bde9-4fad-9965-39c30402d985 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:08.525758 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-aa3c1fe5-7b8b-4c9a-aba0-9fa6073fb6d2 req-43f31e88-bde9-4fad-9965-39c30402d985 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:08.526194 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-aa3c1fe5-7b8b-4c9a-aba0-9fa6073fb6d2 req-43f31e88-bde9-4fad-9965-39c30402d985 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:08.530215 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c6bcf23-077d-4377-a345-71a8eda2eaf5 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:08.530776 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c6bcf23-077d-4377-a345-71a8eda2eaf5 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:08.535088 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:08.559337 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-aa3c1fe5-7b8b-4c9a-aba0-9fa6073fb6d2 req-43f31e88-bde9-4fad-9965-39c30402d985 service nova] Creating event network-changed:f9f1b354-6f60-423b-8ee3-6fff02486c95 for instance 86d751e5-15c5-4cbb-a9af-711aab6bee68 on hv-cinder-85427 Aug 24 08:02:08.573136 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-aa3c1fe5-7b8b-4c9a-aba0-9fa6073fb6d2 req-43f31e88-bde9-4fad-9965-39c30402d985 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085556 Aug 24 08:02:08.574519 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 368/738] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:02:08.589843 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-9ee78d21-55b3-43e9-9e77-bff7c5529a14 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:08.595119 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-9ee78d21-55b3-43e9-9e77-bff7c5529a14 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:08.610286 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9ee78d21-55b3-43e9-9e77-bff7c5529a14 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:08.611990 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9ee78d21-55b3-43e9-9e77-bff7c5529a14 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:08.612698 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9ee78d21-55b3-43e9-9e77-bff7c5529a14 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:08.624160 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9ee78d21-55b3-43e9-9e77-bff7c5529a14 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:08.624883 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9ee78d21-55b3-43e9-9e77-bff7c5529a14 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:08.625962 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9ee78d21-55b3-43e9-9e77-bff7c5529a14 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:08.720109 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.objects.instance [None req-5c6bcf23-077d-4377-a345-71a8eda2eaf5 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lazy-loading 'services' on Instance uuid 86d751e5-15c5-4cbb-a9af-711aab6bee68 {{(pid=127589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:02:08.889796 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9ee78d21-55b3-43e9-9e77-bff7c5529a14 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:08.929461 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-9ee78d21-55b3-43e9-9e77-bff7c5529a14 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1569 microversion: 2.1 time: 0.350771 Aug 24 08:02:08.932368 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 369/739] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:08 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1569 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:08.942798 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-5c6bcf23-077d-4377-a345-71a8eda2eaf5 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "DELETE /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68/os-volume_attachments/3b741d81-fb75-4869-b622-d560b858f602" status: 202 len: 0 microversion: 2.1 time: 0.465425 Aug 24 08:02:08.946547 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 371/740] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 24 08:02:08 2022] DELETE /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68/os-volume_attachments/3b741d81-fb75-4869-b622-d560b858f602 => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:02:08.952405 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-6a46a7c2-ecbb-4fc4-ac95-77a665ceaeb5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:08.952405 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-6a46a7c2-ecbb-4fc4-ac95-77a665ceaeb5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:08.978154 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6a46a7c2-ecbb-4fc4-ac95-77a665ceaeb5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:08.978785 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6a46a7c2-ecbb-4fc4-ac95-77a665ceaeb5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:08.981313 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6a46a7c2-ecbb-4fc4-ac95-77a665ceaeb5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:08.981313 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6a46a7c2-ecbb-4fc4-ac95-77a665ceaeb5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:08.981313 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6a46a7c2-ecbb-4fc4-ac95-77a665ceaeb5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:08.981313 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6a46a7c2-ecbb-4fc4-ac95-77a665ceaeb5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:08.982018 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-cc1f4b74-d0f6-4c8a-a317-d2059947c5f7 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:08.996536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-cc1f4b74-d0f6-4c8a-a317-d2059947c5f7 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:09.014032 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc1f4b74-d0f6-4c8a-a317-d2059947c5f7 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:09.016093 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc1f4b74-d0f6-4c8a-a317-d2059947c5f7 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:09.017018 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc1f4b74-d0f6-4c8a-a317-d2059947c5f7 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:09.018538 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc1f4b74-d0f6-4c8a-a317-d2059947c5f7 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:09.020141 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc1f4b74-d0f6-4c8a-a317-d2059947c5f7 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:09.021184 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc1f4b74-d0f6-4c8a-a317-d2059947c5f7 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:09.073315 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-cc1f4b74-d0f6-4c8a-a317-d2059947c5f7 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107057 Aug 24 08:02:09.073315 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 372/741] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 24 08:02:08 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:02:09.209363 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-6a46a7c2-ecbb-4fc4-ac95-77a665ceaeb5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:09.219300 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-6a46a7c2-ecbb-4fc4-ac95-77a665ceaeb5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:09.221403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-6a46a7c2-ecbb-4fc4-ac95-77a665ceaeb5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:09.223712 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-6a46a7c2-ecbb-4fc4-ac95-77a665ceaeb5 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1730 microversion: 2.20 time: 0.289215 Aug 24 08:02:09.224708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 370/742] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:02:08 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1730 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:02:09.967336 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e2b1d7d3-f169-4cad-8a98-e8a695158410 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:09.968044 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-e2b1d7d3-f169-4cad-8a98-e8a695158410 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:09.974594 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e2b1d7d3-f169-4cad-8a98-e8a695158410 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:09.975157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e2b1d7d3-f169-4cad-8a98-e8a695158410 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:09.975593 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e2b1d7d3-f169-4cad-8a98-e8a695158410 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:09.976300 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e2b1d7d3-f169-4cad-8a98-e8a695158410 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:09.976785 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e2b1d7d3-f169-4cad-8a98-e8a695158410 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:09.977213 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e2b1d7d3-f169-4cad-8a98-e8a695158410 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:10.083966 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-779716ed-0d83-4353-9b1f-25ff938fc50b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:10.086336 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-779716ed-0d83-4353-9b1f-25ff938fc50b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:10.093023 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-779716ed-0d83-4353-9b1f-25ff938fc50b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:10.093587 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-779716ed-0d83-4353-9b1f-25ff938fc50b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:10.094118 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-779716ed-0d83-4353-9b1f-25ff938fc50b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:10.094987 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-779716ed-0d83-4353-9b1f-25ff938fc50b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:10.095537 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-779716ed-0d83-4353-9b1f-25ff938fc50b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:10.095956 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-779716ed-0d83-4353-9b1f-25ff938fc50b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:10.118350 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e2b1d7d3-f169-4cad-8a98-e8a695158410 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:10.126682 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-e2b1d7d3-f169-4cad-8a98-e8a695158410 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1569 microversion: 2.1 time: 0.163192 Aug 24 08:02:10.127259 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 373/743] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:09 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:10.127421 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-779716ed-0d83-4353-9b1f-25ff938fc50b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047960 Aug 24 08:02:10.132243 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 371/744] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 24 08:02:10 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:02:10.249762 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-668ab465-7b42-41cb-9d2a-464292ef7d57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:10.250357 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-668ab465-7b42-41cb-9d2a-464292ef7d57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:10.256583 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-668ab465-7b42-41cb-9d2a-464292ef7d57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:10.257083 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-668ab465-7b42-41cb-9d2a-464292ef7d57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:10.257517 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-668ab465-7b42-41cb-9d2a-464292ef7d57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:10.258204 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-668ab465-7b42-41cb-9d2a-464292ef7d57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:10.258651 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-668ab465-7b42-41cb-9d2a-464292ef7d57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:10.259075 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-668ab465-7b42-41cb-9d2a-464292ef7d57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:10.389440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-668ab465-7b42-41cb-9d2a-464292ef7d57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:10.398200 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-668ab465-7b42-41cb-9d2a-464292ef7d57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:10.399727 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-668ab465-7b42-41cb-9d2a-464292ef7d57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:10.401120 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-668ab465-7b42-41cb-9d2a-464292ef7d57 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1730 microversion: 2.20 time: 0.155282 Aug 24 08:02:10.401841 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 374/745] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:02:10 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:02:11.139442 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-f967f479-3235-44c4-a4bd-a2f33b939804 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:11.145765 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-f967f479-3235-44c4-a4bd-a2f33b939804 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:11.149528 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-0c7d194d-80a3-4714-9503-3aabde04d6cf tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:11.150758 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-0c7d194d-80a3-4714-9503-3aabde04d6cf tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:11.153415 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f967f479-3235-44c4-a4bd-a2f33b939804 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:11.153904 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f967f479-3235-44c4-a4bd-a2f33b939804 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:11.154344 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f967f479-3235-44c4-a4bd-a2f33b939804 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:11.155203 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f967f479-3235-44c4-a4bd-a2f33b939804 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:11.155663 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f967f479-3235-44c4-a4bd-a2f33b939804 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:11.156355 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f967f479-3235-44c4-a4bd-a2f33b939804 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:11.161767 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0c7d194d-80a3-4714-9503-3aabde04d6cf tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:11.163093 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0c7d194d-80a3-4714-9503-3aabde04d6cf tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:11.163969 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0c7d194d-80a3-4714-9503-3aabde04d6cf tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:11.166319 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0c7d194d-80a3-4714-9503-3aabde04d6cf tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:11.167099 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0c7d194d-80a3-4714-9503-3aabde04d6cf tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:11.167872 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0c7d194d-80a3-4714-9503-3aabde04d6cf tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:11.187059 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-f967f479-3235-44c4-a4bd-a2f33b939804 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051559 Aug 24 08:02:11.188271 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 372/746] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 24 08:02:11 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:02:11.366186 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-0c7d194d-80a3-4714-9503-3aabde04d6cf tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:11.374316 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-0c7d194d-80a3-4714-9503-3aabde04d6cf tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1569 microversion: 2.1 time: 0.229951 Aug 24 08:02:11.375141 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 375/747] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:11 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1569 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:02:11.424850 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-240ac092-9f5c-4fdb-9f7e-cb6b00d67dac tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:11.426171 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-240ac092-9f5c-4fdb-9f7e-cb6b00d67dac tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:11.432164 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-240ac092-9f5c-4fdb-9f7e-cb6b00d67dac tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:11.432738 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-240ac092-9f5c-4fdb-9f7e-cb6b00d67dac tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:11.433188 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-240ac092-9f5c-4fdb-9f7e-cb6b00d67dac tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:11.433889 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-240ac092-9f5c-4fdb-9f7e-cb6b00d67dac tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:11.434348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-240ac092-9f5c-4fdb-9f7e-cb6b00d67dac tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:11.434777 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-240ac092-9f5c-4fdb-9f7e-cb6b00d67dac tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:11.569512 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-240ac092-9f5c-4fdb-9f7e-cb6b00d67dac tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:11.578140 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-240ac092-9f5c-4fdb-9f7e-cb6b00d67dac tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:11.579768 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-240ac092-9f5c-4fdb-9f7e-cb6b00d67dac tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:11.580966 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-240ac092-9f5c-4fdb-9f7e-cb6b00d67dac tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1730 microversion: 2.20 time: 0.160072 Aug 24 08:02:11.581717 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 373/748] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:02:11 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:02:12.199886 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-a6a05e67-6de8-4ae0-bb0d-c153023ad100 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:12.202279 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-a6a05e67-6de8-4ae0-bb0d-c153023ad100 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:12.211935 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a6a05e67-6de8-4ae0-bb0d-c153023ad100 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:12.212911 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a6a05e67-6de8-4ae0-bb0d-c153023ad100 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:12.213802 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a6a05e67-6de8-4ae0-bb0d-c153023ad100 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:12.215295 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a6a05e67-6de8-4ae0-bb0d-c153023ad100 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:12.216215 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a6a05e67-6de8-4ae0-bb0d-c153023ad100 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:12.216940 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a6a05e67-6de8-4ae0-bb0d-c153023ad100 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:12.263671 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-a6a05e67-6de8-4ae0-bb0d-c153023ad100 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067883 Aug 24 08:02:12.264221 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 376/749] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 24 08:02:12 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 08:02:12.275405 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-39414987-43fc-4434-9704-e9abd5a01b75 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:12.275925 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-39414987-43fc-4434-9704-e9abd5a01b75 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:12.282605 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-39414987-43fc-4434-9704-e9abd5a01b75 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:12.283079 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-39414987-43fc-4434-9704-e9abd5a01b75 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:12.283508 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-39414987-43fc-4434-9704-e9abd5a01b75 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:12.284200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-39414987-43fc-4434-9704-e9abd5a01b75 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:12.285214 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-39414987-43fc-4434-9704-e9abd5a01b75 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:12.285632 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-39414987-43fc-4434-9704-e9abd5a01b75 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:12.359091 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.wsgi [None req-39414987-43fc-4434-9704-e9abd5a01b75 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] HTTP exception thrown: Instance 86d751e5-15c5-4cbb-a9af-711aab6bee68 is not attached to volume 3b741d81-fb75-4869-b622-d560b858f602 Aug 24 08:02:12.371630 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-39414987-43fc-4434-9704-e9abd5a01b75 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Request method failure captured: Aug 24 08:02:12.371630 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: request: DELETE /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68/os-volume_attachments/3b741d81-fb75-4869-b622-d560b858f602 HTTP/1.1 Aug 24 08:02:12.371630 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept: application/json Aug 24 08:02:12.371630 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept-Encoding: identity Aug 24 08:02:12.371630 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Connection: close Aug 24 08:02:12.371630 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Length: 0 Aug 24 08:02:12.371630 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Type: application/json Aug 24 08:02:12.371630 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Host: 10.222.0.72 Aug 24 08:02:12.371630 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Openstack-System-Scope: None Aug 24 08:02:12.371630 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: User-Agent: python-urllib3/1.26.11 Aug 24 08:02:12.371630 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Auth-Token: gAAAAABjBdpqIU-yQsP7R0qfHIsClzMqiToMV6rAvrj6-odgcFVbsBEFhKQXYAWQ6GokaA93jkDrjwofjW2V5gkVJdV5OAoUzoSU2bDZQ17HpNV2wu6IHxToVhaPLs3tpfBVhbSB5mxG0blXp5HqB0D16BNb_vXiXumy8_AR_OLd29brc_mWfPc Aug 24 08:02:12.371630 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Id: None Aug 24 08:02:12.371630 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Name: None Aug 24 08:02:12.371630 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Identity-Status: Confirmed Aug 24 08:02:12.371630 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Is-Admin-Project: True Aug 24 08:02:12.371630 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Id: default Aug 24 08:02:12.371630 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Name: Default Aug 24 08:02:12.371630 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Id: 4b41efe770974b3aa9a34e21dc2ea5d2 Aug 24 08:02:12.371630 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Name: tempest-TestMinimumBasicScenario-440786839 Aug 24 08:02:12.371630 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Role: reader,member Aug 24 08:02:12.371630 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Roles: reader,member Aug 24 08:02:12.373424 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_4b41efe770974b3aa9a34e21dc2ea5d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/4b41efe770974b3aa9a34e21dc2ea5d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/4b41efe770974b3aa9a34e21dc2ea5d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/4b41efe770974b3aa9a34e21dc2ea5d2"}]}] Aug 24 08:02:12.373424 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant: tempest-TestMinimumBasicScenario-440786839 Aug 24 08:02:12.373424 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Id: 4b41efe770974b3aa9a34e21dc2ea5d2 Aug 24 08:02:12.373424 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Name: tempest-TestMinimumBasicScenario-440786839 Aug 24 08:02:12.373424 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User: tempest-TestMinimumBasicScenario-440786839-project Aug 24 08:02:12.373424 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Id: default Aug 24 08:02:12.373424 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Name: Default Aug 24 08:02:12.373424 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Id: b3fa420e4c0049b9ae5cee7717422cda Aug 24 08:02:12.373424 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Name: tempest-TestMinimumBasicScenario-440786839-project Aug 24 08:02:12.373424 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: method: > Aug 24 08:02:12.373424 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: exception: Instance 86d751e5-15c5-4cbb-a9af-711aab6bee68 is not attached to volume 3b741d81-fb75-4869-b622-d560b858f602 Aug 24 08:02:12.374302 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: action_args: {'server_id': '86d751e5-15c5-4cbb-a9af-711aab6bee68', 'id': '3b741d81-fb75-4869-b622-d560b858f602'} Aug 24 08:02:12.374302 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:02:12.374302 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:12.374302 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 08:02:12.374302 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 08:02:12.374302 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 08:02:12.374302 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 08:02:12.374302 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 08:02:12.374302 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 08:02:12.374302 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3b741d81-fb75-4869-b622-d560b858f602. Aug 24 08:02:12.374302 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:02:12.374302 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:02:12.374302 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:02:12.374302 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:12.374302 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:02:12.374302 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:02:12.374302 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:02:12.374302 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:02:12.374302 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:02:12.375964 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:02:12.375964 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 08:02:12.375964 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 08:02:12.375964 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86d751e5-15c5-4cbb-a9af-711aab6bee68 is not attached to volume 3b741d81-fb75-4869-b622-d560b858f602 Aug 24 08:02:12.375964 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:02:12.375964 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:02:12.375964 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:02:12.375964 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:12.375964 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:02:12.375964 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:02:12.375964 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:02:12.375964 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:02:12.375964 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86d751e5-15c5-4cbb-a9af-711aab6bee68 is not attached to volume 3b741d81-fb75-4869-b622-d560b858f602 Aug 24 08:02:12.375964 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:02:12.375964 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-39414987-43fc-4434-9704-e9abd5a01b75 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Returning 404 to user: Instance 86d751e5-15c5-4cbb-a9af-711aab6bee68 is not attached to volume 3b741d81-fb75-4869-b622-d560b858f602 {{(pid=127590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:02:12.379033 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-39414987-43fc-4434-9704-e9abd5a01b75 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "DELETE /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68/os-volume_attachments/3b741d81-fb75-4869-b622-d560b858f602" status: 404 len: 154 microversion: 2.1 time: 0.102310 Aug 24 08:02:12.379033 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 374/750] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 24 08:02:12 2022] DELETE /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68/os-volume_attachments/3b741d81-fb75-4869-b622-d560b858f602 => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:02:12.396934 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-546b36ea-46f2-47aa-8f4a-9bb81eaae79b tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:12.397630 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-546b36ea-46f2-47aa-8f4a-9bb81eaae79b tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:12.404492 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-546b36ea-46f2-47aa-8f4a-9bb81eaae79b tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:12.409033 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-546b36ea-46f2-47aa-8f4a-9bb81eaae79b tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:12.409033 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-546b36ea-46f2-47aa-8f4a-9bb81eaae79b tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:12.409033 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-546b36ea-46f2-47aa-8f4a-9bb81eaae79b tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:12.409033 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-546b36ea-46f2-47aa-8f4a-9bb81eaae79b tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:12.409491 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-546b36ea-46f2-47aa-8f4a-9bb81eaae79b tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:12.538127 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-546b36ea-46f2-47aa-8f4a-9bb81eaae79b tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:12.545939 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-546b36ea-46f2-47aa-8f4a-9bb81eaae79b tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1569 microversion: 2.1 time: 0.153469 Aug 24 08:02:12.550478 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 377/751] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:12 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:12.604016 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-ff03d0af-07c3-4877-a192-6a82c51210e7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:12.604797 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-ff03d0af-07c3-4877-a192-6a82c51210e7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:12.610816 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ff03d0af-07c3-4877-a192-6a82c51210e7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:12.611297 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ff03d0af-07c3-4877-a192-6a82c51210e7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:12.615415 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ff03d0af-07c3-4877-a192-6a82c51210e7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:12.615415 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ff03d0af-07c3-4877-a192-6a82c51210e7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:12.615415 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ff03d0af-07c3-4877-a192-6a82c51210e7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:12.615415 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ff03d0af-07c3-4877-a192-6a82c51210e7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:12.748687 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-ff03d0af-07c3-4877-a192-6a82c51210e7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:12.758234 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-ff03d0af-07c3-4877-a192-6a82c51210e7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:12.760083 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-ff03d0af-07c3-4877-a192-6a82c51210e7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:12.761411 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-ff03d0af-07c3-4877-a192-6a82c51210e7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1730 microversion: 2.20 time: 0.161659 Aug 24 08:02:12.762186 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 375/752] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:02:12 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:02:13.568512 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-c12b1e9a-cb55-450e-bf5c-a62ea5a1815c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:13.569990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-c12b1e9a-cb55-450e-bf5c-a62ea5a1815c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:13.577034 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c12b1e9a-cb55-450e-bf5c-a62ea5a1815c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:13.577517 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c12b1e9a-cb55-450e-bf5c-a62ea5a1815c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:13.577971 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c12b1e9a-cb55-450e-bf5c-a62ea5a1815c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:13.578660 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c12b1e9a-cb55-450e-bf5c-a62ea5a1815c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:13.579109 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c12b1e9a-cb55-450e-bf5c-a62ea5a1815c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:13.579529 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c12b1e9a-cb55-450e-bf5c-a62ea5a1815c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:13.716746 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-c12b1e9a-cb55-450e-bf5c-a62ea5a1815c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:13.725249 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-c12b1e9a-cb55-450e-bf5c-a62ea5a1815c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1569 microversion: 2.1 time: 0.160509 Aug 24 08:02:13.725807 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 378/753] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:13 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:13.734402 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-6d5f31ca-ed52-4c75-a9ed-986ce6188818 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:13.734916 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-6d5f31ca-ed52-4c75-a9ed-986ce6188818 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:13.741449 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6d5f31ca-ed52-4c75-a9ed-986ce6188818 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:13.741929 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6d5f31ca-ed52-4c75-a9ed-986ce6188818 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:13.742367 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6d5f31ca-ed52-4c75-a9ed-986ce6188818 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:13.743062 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6d5f31ca-ed52-4c75-a9ed-986ce6188818 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:13.743520 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6d5f31ca-ed52-4c75-a9ed-986ce6188818 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:13.743943 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6d5f31ca-ed52-4c75-a9ed-986ce6188818 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:13.769534 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-6d5f31ca-ed52-4c75-a9ed-986ce6188818 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Going to try to terminate instance {{(pid=127590) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:02:13.785565 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-19e668fd-9b38-427a-bff8-edb621759ccf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:13.786259 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-19e668fd-9b38-427a-bff8-edb621759ccf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:13.788188 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=46 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:13.793365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-19e668fd-9b38-427a-bff8-edb621759ccf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:13.794140 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-19e668fd-9b38-427a-bff8-edb621759ccf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:13.794797 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-19e668fd-9b38-427a-bff8-edb621759ccf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:13.795502 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-19e668fd-9b38-427a-bff8-edb621759ccf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:13.795952 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-19e668fd-9b38-427a-bff8-edb621759ccf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:13.796372 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-19e668fd-9b38-427a-bff8-edb621759ccf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:13.930042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-19e668fd-9b38-427a-bff8-edb621759ccf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:13.938583 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-19e668fd-9b38-427a-bff8-edb621759ccf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:13.940208 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-19e668fd-9b38-427a-bff8-edb621759ccf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:13.941892 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-19e668fd-9b38-427a-bff8-edb621759ccf tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1730 microversion: 2.20 time: 0.161713 Aug 24 08:02:13.942444 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 379/754] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:02:13 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:02:14.162719 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-6d5f31ca-ed52-4c75-a9ed-986ce6188818 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "DELETE /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 204 len: 0 microversion: 2.1 time: 0.431585 Aug 24 08:02:14.163326 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 376/755] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 24 08:02:13 2022] DELETE /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:02:14.177893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-ac23398b-ac54-4979-8076-a289c28481d0 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:14.177893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-ac23398b-ac54-4979-8076-a289c28481d0 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:14.178473 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ac23398b-ac54-4979-8076-a289c28481d0 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:14.178963 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ac23398b-ac54-4979-8076-a289c28481d0 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:14.179401 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ac23398b-ac54-4979-8076-a289c28481d0 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:14.180619 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ac23398b-ac54-4979-8076-a289c28481d0 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:14.180619 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ac23398b-ac54-4979-8076-a289c28481d0 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:14.180979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ac23398b-ac54-4979-8076-a289c28481d0 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:14.310870 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-ac23398b-ac54-4979-8076-a289c28481d0 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:14.319336 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-ac23398b-ac54-4979-8076-a289c28481d0 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1555 microversion: 2.1 time: 0.151736 Aug 24 08:02:14.319906 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 380/756] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:14 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:14.747685 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-8b39ac86-49ab-4fb6-a2ca-b39812820ead tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:14.747685 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-8b39ac86-49ab-4fb6-a2ca-b39812820ead tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:14.754323 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8b39ac86-49ab-4fb6-a2ca-b39812820ead tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:14.754808 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8b39ac86-49ab-4fb6-a2ca-b39812820ead tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:14.755184 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-f67823c0-c57f-4475-b80f-4f9676faf439 req-3b57c14f-1bd0-4608-a144-601629e2d31c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "771d249a-e50d-4848-b6ab-cb76685964d7", "name": "network-vif-plugged", "status": "completed", "tag": "f4073395-cdc8-42de-89a0-3e684efbce28"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:02:14.755630 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8b39ac86-49ab-4fb6-a2ca-b39812820ead tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:14.756032 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8b39ac86-49ab-4fb6-a2ca-b39812820ead tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:14.756486 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8b39ac86-49ab-4fb6-a2ca-b39812820ead tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:14.756931 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8b39ac86-49ab-4fb6-a2ca-b39812820ead tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:14.765878 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-f67823c0-c57f-4475-b80f-4f9676faf439 req-3b57c14f-1bd0-4608-a144-601629e2d31c service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:14.766428 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-f67823c0-c57f-4475-b80f-4f9676faf439 req-3b57c14f-1bd0-4608-a144-601629e2d31c service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:14.766870 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-f67823c0-c57f-4475-b80f-4f9676faf439 req-3b57c14f-1bd0-4608-a144-601629e2d31c service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:14.778240 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-f67823c0-c57f-4475-b80f-4f9676faf439 req-3b57c14f-1bd0-4608-a144-601629e2d31c service nova] Creating event network-vif-plugged:f4073395-cdc8-42de-89a0-3e684efbce28 for instance 771d249a-e50d-4848-b6ab-cb76685964d7 on hv-cinder-85427 Aug 24 08:02:14.783554 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-f67823c0-c57f-4475-b80f-4f9676faf439 req-3b57c14f-1bd0-4608-a144-601629e2d31c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032675 Aug 24 08:02:14.784155 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 381/757] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:02:14.897929 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-8b39ac86-49ab-4fb6-a2ca-b39812820ead tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:14.907239 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-8b39ac86-49ab-4fb6-a2ca-b39812820ead tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1569 microversion: 2.1 time: 0.164901 Aug 24 08:02:14.908045 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 377/758] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:14 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:14.966021 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-36a55af0-9279-4856-887b-bd331492c364 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:14.966807 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-36a55af0-9279-4856-887b-bd331492c364 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:14.973952 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-36a55af0-9279-4856-887b-bd331492c364 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:14.974450 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-36a55af0-9279-4856-887b-bd331492c364 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:14.974987 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-36a55af0-9279-4856-887b-bd331492c364 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:14.975769 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-36a55af0-9279-4856-887b-bd331492c364 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:14.976303 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-36a55af0-9279-4856-887b-bd331492c364 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:14.976834 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-36a55af0-9279-4856-887b-bd331492c364 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:15.119257 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-36a55af0-9279-4856-887b-bd331492c364 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:15.120762 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-36a55af0-9279-4856-887b-bd331492c364 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:15.122304 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-36a55af0-9279-4856-887b-bd331492c364 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:15.123458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-36a55af0-9279-4856-887b-bd331492c364 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1730 microversion: 2.20 time: 0.161862 Aug 24 08:02:15.124144 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 382/759] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:02:14 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:02:15.340052 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-3cb282ce-01ac-4b15-bf1c-3642d785a20f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:15.340674 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-3cb282ce-01ac-4b15-bf1c-3642d785a20f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:15.342642 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:15.347922 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3cb282ce-01ac-4b15-bf1c-3642d785a20f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:15.348401 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3cb282ce-01ac-4b15-bf1c-3642d785a20f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:15.348869 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3cb282ce-01ac-4b15-bf1c-3642d785a20f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:15.353913 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3cb282ce-01ac-4b15-bf1c-3642d785a20f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:15.353913 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3cb282ce-01ac-4b15-bf1c-3642d785a20f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:15.353913 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3cb282ce-01ac-4b15-bf1c-3642d785a20f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:15.478660 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-3cb282ce-01ac-4b15-bf1c-3642d785a20f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:15.486810 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-3cb282ce-01ac-4b15-bf1c-3642d785a20f tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1555 microversion: 2.1 time: 0.150451 Aug 24 08:02:15.487562 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 378/760] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:15 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:15.941589 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-7c29ebc1-9507-4e47-8143-70e63cf4b8ee tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:15.942174 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-7c29ebc1-9507-4e47-8143-70e63cf4b8ee tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:15.949026 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7c29ebc1-9507-4e47-8143-70e63cf4b8ee tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:15.949615 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7c29ebc1-9507-4e47-8143-70e63cf4b8ee tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:15.950044 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7c29ebc1-9507-4e47-8143-70e63cf4b8ee tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:15.950747 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7c29ebc1-9507-4e47-8143-70e63cf4b8ee tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:15.951195 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7c29ebc1-9507-4e47-8143-70e63cf4b8ee tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:15.951614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7c29ebc1-9507-4e47-8143-70e63cf4b8ee tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:16.146777 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-df7a3d28-20f4-4c1b-8b7b-82e85108e909 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:16.147973 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-df7a3d28-20f4-4c1b-8b7b-82e85108e909 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:16.154662 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-df7a3d28-20f4-4c1b-8b7b-82e85108e909 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:16.155148 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-df7a3d28-20f4-4c1b-8b7b-82e85108e909 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:16.155590 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-df7a3d28-20f4-4c1b-8b7b-82e85108e909 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:16.156551 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-df7a3d28-20f4-4c1b-8b7b-82e85108e909 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:16.157029 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-df7a3d28-20f4-4c1b-8b7b-82e85108e909 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:16.157456 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-df7a3d28-20f4-4c1b-8b7b-82e85108e909 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:16.162072 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:16.192110 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7c29ebc1-9507-4e47-8143-70e63cf4b8ee tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:16.200689 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-7c29ebc1-9507-4e47-8143-70e63cf4b8ee tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1569 microversion: 2.1 time: 0.263786 Aug 24 08:02:16.201467 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 383/761] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:15 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1569 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:16.288869 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-df7a3d28-20f4-4c1b-8b7b-82e85108e909 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:16.297430 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-df7a3d28-20f4-4c1b-8b7b-82e85108e909 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:16.299001 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-df7a3d28-20f4-4c1b-8b7b-82e85108e909 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:16.301248 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-df7a3d28-20f4-4c1b-8b7b-82e85108e909 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1730 microversion: 2.20 time: 0.158198 Aug 24 08:02:16.302163 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 379/762] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:02:16 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:02:16.511541 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-d7fe9a58-759f-48e8-88b4-9cdcb0f9a6c1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:16.512167 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-d7fe9a58-759f-48e8-88b4-9cdcb0f9a6c1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:16.518332 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d7fe9a58-759f-48e8-88b4-9cdcb0f9a6c1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:16.519367 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d7fe9a58-759f-48e8-88b4-9cdcb0f9a6c1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:16.519812 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d7fe9a58-759f-48e8-88b4-9cdcb0f9a6c1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:16.520521 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d7fe9a58-759f-48e8-88b4-9cdcb0f9a6c1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:16.521005 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d7fe9a58-759f-48e8-88b4-9cdcb0f9a6c1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:16.521431 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d7fe9a58-759f-48e8-88b4-9cdcb0f9a6c1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:16.557772 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-55086bcc-af66-44bf-b134-edf57016ce17 req-f50833e4-f61b-4b9b-97c7-06d969b6c6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86d751e5-15c5-4cbb-a9af-711aab6bee68", "name": "network-vif-deleted", "tag": "f9f1b354-6f60-423b-8ee3-6fff02486c95"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:02:16.567429 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-55086bcc-af66-44bf-b134-edf57016ce17 req-f50833e4-f61b-4b9b-97c7-06d969b6c6d0 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:16.567904 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-55086bcc-af66-44bf-b134-edf57016ce17 req-f50833e4-f61b-4b9b-97c7-06d969b6c6d0 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:16.568333 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-55086bcc-af66-44bf-b134-edf57016ce17 req-f50833e4-f61b-4b9b-97c7-06d969b6c6d0 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:16.579689 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-55086bcc-af66-44bf-b134-edf57016ce17 req-f50833e4-f61b-4b9b-97c7-06d969b6c6d0 service nova] Creating event network-vif-deleted:f9f1b354-6f60-423b-8ee3-6fff02486c95 for instance 86d751e5-15c5-4cbb-a9af-711aab6bee68 on hv-cinder-85427 Aug 24 08:02:16.583246 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-d7fe9a58-759f-48e8-88b4-9cdcb0f9a6c1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:16.585651 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-55086bcc-af66-44bf-b134-edf57016ce17 req-f50833e4-f61b-4b9b-97c7-06d969b6c6d0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031492 Aug 24 08:02:16.586270 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 380/763] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:02:16.591593 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-d7fe9a58-759f-48e8-88b4-9cdcb0f9a6c1 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1513 microversion: 2.1 time: 0.083898 Aug 24 08:02:16.592154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 384/764] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:16 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1513 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:17.225749 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-4a03f2fd-cef5-477a-a5da-e28464fbc4e8 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:17.226749 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-4a03f2fd-cef5-477a-a5da-e28464fbc4e8 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:17.238950 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4a03f2fd-cef5-477a-a5da-e28464fbc4e8 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:17.239719 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4a03f2fd-cef5-477a-a5da-e28464fbc4e8 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:17.240402 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4a03f2fd-cef5-477a-a5da-e28464fbc4e8 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:17.241571 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4a03f2fd-cef5-477a-a5da-e28464fbc4e8 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:17.242258 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4a03f2fd-cef5-477a-a5da-e28464fbc4e8 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:17.242691 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4a03f2fd-cef5-477a-a5da-e28464fbc4e8 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:17.323505 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-fc9c78fa-6c6b-4fff-bb99-5c20efd6c9c7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:17.324393 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-fc9c78fa-6c6b-4fff-bb99-5c20efd6c9c7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:17.332052 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fc9c78fa-6c6b-4fff-bb99-5c20efd6c9c7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:17.332551 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fc9c78fa-6c6b-4fff-bb99-5c20efd6c9c7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:17.333012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fc9c78fa-6c6b-4fff-bb99-5c20efd6c9c7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:17.333740 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fc9c78fa-6c6b-4fff-bb99-5c20efd6c9c7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:17.334253 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fc9c78fa-6c6b-4fff-bb99-5c20efd6c9c7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:17.334619 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fc9c78fa-6c6b-4fff-bb99-5c20efd6c9c7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:17.394275 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-4a03f2fd-cef5-477a-a5da-e28464fbc4e8 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:17.404431 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-4a03f2fd-cef5-477a-a5da-e28464fbc4e8 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1569 microversion: 2.1 time: 0.181758 Aug 24 08:02:17.404431 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 381/765] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:17 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:17.491611 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-fc9c78fa-6c6b-4fff-bb99-5c20efd6c9c7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:17.500065 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-fc9c78fa-6c6b-4fff-bb99-5c20efd6c9c7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:17.501635 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-fc9c78fa-6c6b-4fff-bb99-5c20efd6c9c7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:17.502817 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-fc9c78fa-6c6b-4fff-bb99-5c20efd6c9c7 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1730 microversion: 2.20 time: 0.183252 Aug 24 08:02:17.503951 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 385/766] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:02:17 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:02:17.613506 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-4151e7f5-fd58-4c5f-b5c6-ea8ea1eec900 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:17.614109 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-4151e7f5-fd58-4c5f-b5c6-ea8ea1eec900 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:17.620014 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4151e7f5-fd58-4c5f-b5c6-ea8ea1eec900 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:17.620491 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4151e7f5-fd58-4c5f-b5c6-ea8ea1eec900 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:17.620959 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4151e7f5-fd58-4c5f-b5c6-ea8ea1eec900 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:17.621649 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4151e7f5-fd58-4c5f-b5c6-ea8ea1eec900 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:17.622091 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4151e7f5-fd58-4c5f-b5c6-ea8ea1eec900 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:17.622508 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4151e7f5-fd58-4c5f-b5c6-ea8ea1eec900 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:17.651600 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4151e7f5-fd58-4c5f-b5c6-ea8ea1eec900 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:17.652026 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4151e7f5-fd58-4c5f-b5c6-ea8ea1eec900 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:17.652451 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4151e7f5-fd58-4c5f-b5c6-ea8ea1eec900 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:17.652922 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.objects.instance [None req-4151e7f5-fd58-4c5f-b5c6-ea8ea1eec900 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lazy-loading 'fault' on Instance uuid 86d751e5-15c5-4cbb-a9af-711aab6bee68 {{(pid=127590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:02:17.692912 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-4151e7f5-fd58-4c5f-b5c6-ea8ea1eec900 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fa420e4c0049b9ae5cee7717422cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b41efe770974b3aa9a34e21dc2ea5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:17.700857 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-4151e7f5-fd58-4c5f-b5c6-ea8ea1eec900 tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 200 len: 1349 microversion: 2.1 time: 0.091730 Aug 24 08:02:17.701562 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 382/767] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:17 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:18.423714 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-fba75639-d629-4206-9270-24c249868a5a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:18.424320 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-fba75639-d629-4206-9270-24c249868a5a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:18.430762 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fba75639-d629-4206-9270-24c249868a5a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:18.431245 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fba75639-d629-4206-9270-24c249868a5a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:18.431671 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fba75639-d629-4206-9270-24c249868a5a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:18.432356 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fba75639-d629-4206-9270-24c249868a5a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:18.432841 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fba75639-d629-4206-9270-24c249868a5a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:18.433258 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fba75639-d629-4206-9270-24c249868a5a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:18.527046 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-e7b2412b-d5aa-426a-9235-3501a4053287 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:18.527825 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-e7b2412b-d5aa-426a-9235-3501a4053287 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:18.535394 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e7b2412b-d5aa-426a-9235-3501a4053287 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:18.536259 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e7b2412b-d5aa-426a-9235-3501a4053287 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:18.536852 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e7b2412b-d5aa-426a-9235-3501a4053287 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:18.537670 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e7b2412b-d5aa-426a-9235-3501a4053287 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:18.538239 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e7b2412b-d5aa-426a-9235-3501a4053287 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:18.538787 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e7b2412b-d5aa-426a-9235-3501a4053287 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:18.585196 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-fba75639-d629-4206-9270-24c249868a5a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:18.595712 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-fba75639-d629-4206-9270-24c249868a5a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1569 microversion: 2.1 time: 0.175579 Aug 24 08:02:18.598033 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 386/768] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:18 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:18.696277 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-e7b2412b-d5aa-426a-9235-3501a4053287 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:18.704407 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-e7b2412b-d5aa-426a-9235-3501a4053287 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:18.705933 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-e7b2412b-d5aa-426a-9235-3501a4053287 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:18.707646 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-e7b2412b-d5aa-426a-9235-3501a4053287 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1730 microversion: 2.20 time: 0.185137 Aug 24 08:02:18.708206 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 383/769] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:02:18 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:02:18.726471 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-49e090ca-cb34-44ff-84ec-37adff84917b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:18.727087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-49e090ca-cb34-44ff-84ec-37adff84917b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] [instance: 86d751e5-15c5-4cbb-a9af-711aab6bee68] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:18.733030 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-49e090ca-cb34-44ff-84ec-37adff84917b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:18.733518 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-49e090ca-cb34-44ff-84ec-37adff84917b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:18.733960 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-49e090ca-cb34-44ff-84ec-37adff84917b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:18.734680 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-49e090ca-cb34-44ff-84ec-37adff84917b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:18.735137 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-49e090ca-cb34-44ff-84ec-37adff84917b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:18.735570 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-49e090ca-cb34-44ff-84ec-37adff84917b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:18.749550 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-49e090ca-cb34-44ff-84ec-37adff84917b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] HTTP exception thrown: Instance 86d751e5-15c5-4cbb-a9af-711aab6bee68 could not be found. Aug 24 08:02:18.751175 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-49e090ca-cb34-44ff-84ec-37adff84917b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Request method failure captured: Aug 24 08:02:18.751175 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 HTTP/1.1 Aug 24 08:02:18.751175 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 08:02:18.751175 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 08:02:18.751175 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 08:02:18.751175 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 08:02:18.751175 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 08:02:18.751175 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 08:02:18.751175 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 08:02:18.751175 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 08:02:18.751175 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdpqIU-yQsP7R0qfHIsClzMqiToMV6rAvrj6-odgcFVbsBEFhKQXYAWQ6GokaA93jkDrjwofjW2V5gkVJdV5OAoUzoSU2bDZQ17HpNV2wu6IHxToVhaPLs3tpfBVhbSB5mxG0blXp5HqB0D16BNb_vXiXumy8_AR_OLd29brc_mWfPc Aug 24 08:02:18.751175 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 08:02:18.751175 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 08:02:18.751175 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 08:02:18.751175 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 08:02:18.751175 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 08:02:18.751175 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 08:02:18.751175 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: 4b41efe770974b3aa9a34e21dc2ea5d2 Aug 24 08:02:18.751175 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-TestMinimumBasicScenario-440786839 Aug 24 08:02:18.751175 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 08:02:18.751175 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 08:02:18.752911 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_4b41efe770974b3aa9a34e21dc2ea5d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/4b41efe770974b3aa9a34e21dc2ea5d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/4b41efe770974b3aa9a34e21dc2ea5d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/4b41efe770974b3aa9a34e21dc2ea5d2"}]}] Aug 24 08:02:18.752911 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-TestMinimumBasicScenario-440786839 Aug 24 08:02:18.752911 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: 4b41efe770974b3aa9a34e21dc2ea5d2 Aug 24 08:02:18.752911 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-TestMinimumBasicScenario-440786839 Aug 24 08:02:18.752911 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-TestMinimumBasicScenario-440786839-project Aug 24 08:02:18.752911 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 08:02:18.752911 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 08:02:18.752911 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: b3fa420e4c0049b9ae5cee7717422cda Aug 24 08:02:18.752911 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-TestMinimumBasicScenario-440786839-project Aug 24 08:02:18.752911 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 08:02:18.752911 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Instance 86d751e5-15c5-4cbb-a9af-711aab6bee68 could not be found. Aug 24 08:02:18.752911 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': '86d751e5-15c5-4cbb-a9af-711aab6bee68'} Aug 24 08:02:18.754471 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:02:18.754471 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:18.754471 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:02:18.754471 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:02:18.754471 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:02:18.754471 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:02:18.754471 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:02:18.754471 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:02:18.754471 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:02:18.754471 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:02:18.754471 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86d751e5-15c5-4cbb-a9af-711aab6bee68 could not be found. Aug 24 08:02:18.754471 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:02:18.754471 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:02:18.754471 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:02:18.754471 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:18.754471 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:02:18.754471 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:02:18.754471 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:02:18.754471 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:02:18.754471 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:02:18.755937 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:02:18.755937 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:02:18.755937 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:02:18.755937 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:02:18.755937 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:02:18.755937 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:02:18.755937 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:02:18.755937 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86d751e5-15c5-4cbb-a9af-711aab6bee68 could not be found. Aug 24 08:02:18.755937 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:02:18.755937 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:02:18.755937 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:02:18.755937 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:18.755937 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:02:18.755937 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:02:18.755937 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:02:18.755937 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:02:18.755937 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86d751e5-15c5-4cbb-a9af-711aab6bee68 could not be found. Aug 24 08:02:18.755937 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:02:18.757362 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-49e090ca-cb34-44ff-84ec-37adff84917b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Returning 404 to user: Instance 86d751e5-15c5-4cbb-a9af-711aab6bee68 could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:02:18.757362 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-49e090ca-cb34-44ff-84ec-37adff84917b tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68" status: 404 len: 111 microversion: 2.1 time: 0.030033 Aug 24 08:02:18.757362 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 387/770] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:18 2022] GET /compute/v2.1/servers/86d751e5-15c5-4cbb-a9af-711aab6bee68 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:02:18.762607 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-852cc075-758c-4ba7-94ae-eca5a755131c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] Calling method '.version_select at 0x7f320c190160>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:18.866927 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-852cc075-758c-4ba7-94ae-eca5a755131c tempest-TestMinimumBasicScenario-440786839 tempest-TestMinimumBasicScenario-440786839-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2059212825" status: 202 len: 0 microversion: 2.1 time: 0.108027 Aug 24 08:02:18.867531 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 384/771] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 24 08:02:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2059212825 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:02:19.622991 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-ceaf43e6-c915-41eb-92de-9f97d8c4f65f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:19.623589 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-ceaf43e6-c915-41eb-92de-9f97d8c4f65f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:19.630237 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ceaf43e6-c915-41eb-92de-9f97d8c4f65f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:19.630931 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ceaf43e6-c915-41eb-92de-9f97d8c4f65f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:19.631587 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ceaf43e6-c915-41eb-92de-9f97d8c4f65f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:19.632392 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ceaf43e6-c915-41eb-92de-9f97d8c4f65f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:19.632872 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ceaf43e6-c915-41eb-92de-9f97d8c4f65f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:19.633315 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ceaf43e6-c915-41eb-92de-9f97d8c4f65f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:19.649517 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:19.730887 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-4993b170-0f78-4d65-aab8-8d8401d9d9ee tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:19.731492 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-4993b170-0f78-4d65-aab8-8d8401d9d9ee tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:19.737801 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4993b170-0f78-4d65-aab8-8d8401d9d9ee tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:19.738861 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4993b170-0f78-4d65-aab8-8d8401d9d9ee tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:19.739299 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4993b170-0f78-4d65-aab8-8d8401d9d9ee tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:19.739997 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4993b170-0f78-4d65-aab8-8d8401d9d9ee tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:19.740449 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4993b170-0f78-4d65-aab8-8d8401d9d9ee tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:19.740893 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4993b170-0f78-4d65-aab8-8d8401d9d9ee tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:19.826729 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-ceaf43e6-c915-41eb-92de-9f97d8c4f65f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:19.845430 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-ceaf43e6-c915-41eb-92de-9f97d8c4f65f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1569 microversion: 2.1 time: 0.218227 Aug 24 08:02:19.845430 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 388/772] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:19 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:19.892293 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-4993b170-0f78-4d65-aab8-8d8401d9d9ee tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:19.901572 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-4993b170-0f78-4d65-aab8-8d8401d9d9ee tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:19.903010 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-4993b170-0f78-4d65-aab8-8d8401d9d9ee tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:19.904344 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-4993b170-0f78-4d65-aab8-8d8401d9d9ee tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1717 microversion: 2.20 time: 0.177975 Aug 24 08:02:19.904962 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 385/773] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:02:19 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1717 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:02:20.858573 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-881bea7e-5ba0-42a7-ae48-d033482040f1 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:20.859183 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-881bea7e-5ba0-42a7-ae48-d033482040f1 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:20.866985 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-881bea7e-5ba0-42a7-ae48-d033482040f1 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:20.867468 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-881bea7e-5ba0-42a7-ae48-d033482040f1 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:20.867908 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-881bea7e-5ba0-42a7-ae48-d033482040f1 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:20.868606 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-881bea7e-5ba0-42a7-ae48-d033482040f1 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:20.869101 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-881bea7e-5ba0-42a7-ae48-d033482040f1 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:20.869528 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-881bea7e-5ba0-42a7-ae48-d033482040f1 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:21.061113 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-881bea7e-5ba0-42a7-ae48-d033482040f1 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:21.071242 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-881bea7e-5ba0-42a7-ae48-d033482040f1 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1569 microversion: 2.1 time: 0.216545 Aug 24 08:02:21.072122 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 389/774] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:20 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1569 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:22.098239 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-d18f13da-12a8-437a-a2a5-b1d2f0d067fa tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:22.100016 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-d18f13da-12a8-437a-a2a5-b1d2f0d067fa tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:22.119468 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d18f13da-12a8-437a-a2a5-b1d2f0d067fa tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:22.120317 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d18f13da-12a8-437a-a2a5-b1d2f0d067fa tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:22.121021 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d18f13da-12a8-437a-a2a5-b1d2f0d067fa tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:22.122126 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d18f13da-12a8-437a-a2a5-b1d2f0d067fa tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:22.123000 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d18f13da-12a8-437a-a2a5-b1d2f0d067fa tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:22.124230 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d18f13da-12a8-437a-a2a5-b1d2f0d067fa tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:22.429697 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-d18f13da-12a8-437a-a2a5-b1d2f0d067fa tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:22.440365 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-d18f13da-12a8-437a-a2a5-b1d2f0d067fa tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1569 microversion: 2.1 time: 0.346725 Aug 24 08:02:22.442997 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 386/775] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:22 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1569 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:23.462944 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-7d52fd15-20e4-46ba-ab47-7a2eefbee22f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:23.463556 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-7d52fd15-20e4-46ba-ab47-7a2eefbee22f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:23.470532 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7d52fd15-20e4-46ba-ab47-7a2eefbee22f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:23.471010 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7d52fd15-20e4-46ba-ab47-7a2eefbee22f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:23.471449 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7d52fd15-20e4-46ba-ab47-7a2eefbee22f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:23.472158 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7d52fd15-20e4-46ba-ab47-7a2eefbee22f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:23.472612 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7d52fd15-20e4-46ba-ab47-7a2eefbee22f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:23.473067 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7d52fd15-20e4-46ba-ab47-7a2eefbee22f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:23.711359 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7d52fd15-20e4-46ba-ab47-7a2eefbee22f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:23.724393 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-7d52fd15-20e4-46ba-ab47-7a2eefbee22f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1510 microversion: 2.1 time: 0.265174 Aug 24 08:02:23.728344 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 390/776] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:23 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1510 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:23.748188 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-82dbee3f-2b7c-4ab9-881f-89dcff9e8498 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:02:23.749048 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-82dbee3f-2b7c-4ab9-881f-89dcff9e8498 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:23.769542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-82dbee3f-2b7c-4ab9-881f-89dcff9e8498 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:23.772172 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-82dbee3f-2b7c-4ab9-881f-89dcff9e8498 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:23.772500 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-82dbee3f-2b7c-4ab9-881f-89dcff9e8498 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:23.773259 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-82dbee3f-2b7c-4ab9-881f-89dcff9e8498 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:23.773718 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-82dbee3f-2b7c-4ab9-881f-89dcff9e8498 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:23.774590 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-82dbee3f-2b7c-4ab9-881f-89dcff9e8498 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:23.811941 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-82dbee3f-2b7c-4ab9-881f-89dcff9e8498 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127590) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 08:02:24.206469 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-82dbee3f-2b7c-4ab9-881f-89dcff9e8498 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "POST /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c/action" status: 202 len: 0 microversion: 2.1 time: 0.462362 Aug 24 08:02:24.208856 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 387/777] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 24 08:02:23 2022] POST /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 08:02:24.216345 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-2c8b9190-d960-4799-a68e-abe3ccf55f51 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:24.217173 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-2c8b9190-d960-4799-a68e-abe3ccf55f51 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:24.227122 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2c8b9190-d960-4799-a68e-abe3ccf55f51 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:24.228369 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2c8b9190-d960-4799-a68e-abe3ccf55f51 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:24.229579 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2c8b9190-d960-4799-a68e-abe3ccf55f51 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:24.230948 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2c8b9190-d960-4799-a68e-abe3ccf55f51 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:24.231604 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2c8b9190-d960-4799-a68e-abe3ccf55f51 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:24.232220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2c8b9190-d960-4799-a68e-abe3ccf55f51 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:24.391275 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-2c8b9190-d960-4799-a68e-abe3ccf55f51 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:24.406138 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-2c8b9190-d960-4799-a68e-abe3ccf55f51 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1518 microversion: 2.1 time: 0.187604 Aug 24 08:02:24.407788 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 391/778] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:24 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1518 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:24.799028 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-582fe4cf-dd91-44af-8e76-cce53ea37587 req-6a7f1361-5528-4603-ba49-8cfc0faadba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce799f4-91d9-4521-af5d-63757a11823c", "name": "network-vif-unplugged", "status": "completed", "tag": "b6e8c168-af88-483f-9e17-53d9c3c9d376"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:02:24.809098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-582fe4cf-dd91-44af-8e76-cce53ea37587 req-6a7f1361-5528-4603-ba49-8cfc0faadba7 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:24.809575 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-582fe4cf-dd91-44af-8e76-cce53ea37587 req-6a7f1361-5528-4603-ba49-8cfc0faadba7 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:24.810011 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-582fe4cf-dd91-44af-8e76-cce53ea37587 req-6a7f1361-5528-4603-ba49-8cfc0faadba7 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:24.821653 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.compute.server_external_events [req-582fe4cf-dd91-44af-8e76-cce53ea37587 req-6a7f1361-5528-4603-ba49-8cfc0faadba7 service nova] Unable to find a host for instance 3ce799f4-91d9-4521-af5d-63757a11823c. Dropping event network-vif-unplugged {{(pid=127590) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 08:02:24.822462 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-582fe4cf-dd91-44af-8e76-cce53ea37587 req-6a7f1361-5528-4603-ba49-8cfc0faadba7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027828 Aug 24 08:02:24.823034 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 388/779] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 24 08:02:25.428483 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-6079ed81-ed89-496b-861b-fc9c18ba3941 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:25.430503 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-6079ed81-ed89-496b-861b-fc9c18ba3941 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:25.438460 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6079ed81-ed89-496b-861b-fc9c18ba3941 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:25.439168 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6079ed81-ed89-496b-861b-fc9c18ba3941 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:25.439777 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6079ed81-ed89-496b-861b-fc9c18ba3941 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:25.440668 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6079ed81-ed89-496b-861b-fc9c18ba3941 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:25.441364 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6079ed81-ed89-496b-861b-fc9c18ba3941 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:25.442023 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6079ed81-ed89-496b-861b-fc9c18ba3941 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:25.730983 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-6079ed81-ed89-496b-861b-fc9c18ba3941 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:25.739011 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-6079ed81-ed89-496b-861b-fc9c18ba3941 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1518 microversion: 2.1 time: 0.315333 Aug 24 08:02:25.739663 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 392/780] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:25 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1518 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:26.759381 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-5bb8df98-5e01-4ee6-95e2-2ab67fd9e83b tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:26.760983 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-5bb8df98-5e01-4ee6-95e2-2ab67fd9e83b tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:26.778207 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5bb8df98-5e01-4ee6-95e2-2ab67fd9e83b tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:26.778700 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5bb8df98-5e01-4ee6-95e2-2ab67fd9e83b tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:26.779141 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5bb8df98-5e01-4ee6-95e2-2ab67fd9e83b tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:26.779855 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5bb8df98-5e01-4ee6-95e2-2ab67fd9e83b tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:26.780307 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5bb8df98-5e01-4ee6-95e2-2ab67fd9e83b tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:26.781004 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5bb8df98-5e01-4ee6-95e2-2ab67fd9e83b tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:26.941526 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-5bb8df98-5e01-4ee6-95e2-2ab67fd9e83b tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:26.949357 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-5bb8df98-5e01-4ee6-95e2-2ab67fd9e83b tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1520 microversion: 2.1 time: 0.193837 Aug 24 08:02:26.949920 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 389/781] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:26 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:02:27.971460 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-679b77b0-3ec6-4ece-8543-db92bc3311fb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:27.972722 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-679b77b0-3ec6-4ece-8543-db92bc3311fb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:27.983443 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-679b77b0-3ec6-4ece-8543-db92bc3311fb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:27.984432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-679b77b0-3ec6-4ece-8543-db92bc3311fb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:27.984432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-679b77b0-3ec6-4ece-8543-db92bc3311fb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:27.985105 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-679b77b0-3ec6-4ece-8543-db92bc3311fb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:27.985560 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-679b77b0-3ec6-4ece-8543-db92bc3311fb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:27.985991 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-679b77b0-3ec6-4ece-8543-db92bc3311fb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:28.233143 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-679b77b0-3ec6-4ece-8543-db92bc3311fb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:28.248599 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-679b77b0-3ec6-4ece-8543-db92bc3311fb tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1576 microversion: 2.1 time: 0.280961 Aug 24 08:02:28.249325 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 393/782] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:27 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1576 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:29.270160 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-10436a21-eee7-4475-916d-688ff8266faa tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:29.270759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-10436a21-eee7-4475-916d-688ff8266faa tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:29.277105 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-10436a21-eee7-4475-916d-688ff8266faa tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:29.277586 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-10436a21-eee7-4475-916d-688ff8266faa tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:29.278186 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-10436a21-eee7-4475-916d-688ff8266faa tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:29.279027 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-10436a21-eee7-4475-916d-688ff8266faa tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:29.279628 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-10436a21-eee7-4475-916d-688ff8266faa tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:29.280225 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-10436a21-eee7-4475-916d-688ff8266faa tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:29.437787 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-10436a21-eee7-4475-916d-688ff8266faa tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:29.446077 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-10436a21-eee7-4475-916d-688ff8266faa tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1576 microversion: 2.1 time: 0.180442 Aug 24 08:02:29.452844 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 390/783] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:29 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:30.466159 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-fbbb04ab-318c-4df3-ab5c-ecd8993721b5 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:30.466863 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-fbbb04ab-318c-4df3-ab5c-ecd8993721b5 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:30.473251 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fbbb04ab-318c-4df3-ab5c-ecd8993721b5 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:30.473733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fbbb04ab-318c-4df3-ab5c-ecd8993721b5 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:30.474296 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fbbb04ab-318c-4df3-ab5c-ecd8993721b5 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:30.474867 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fbbb04ab-318c-4df3-ab5c-ecd8993721b5 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:30.475319 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fbbb04ab-318c-4df3-ab5c-ecd8993721b5 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:30.475845 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fbbb04ab-318c-4df3-ab5c-ecd8993721b5 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:30.608382 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-fbbb04ab-318c-4df3-ab5c-ecd8993721b5 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:30.616253 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-fbbb04ab-318c-4df3-ab5c-ecd8993721b5 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1576 microversion: 2.1 time: 0.153973 Aug 24 08:02:30.616831 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 394/784] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:30 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:31.637706 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-b1833b1c-de9a-4d7b-9c40-b00703b191f4 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:31.638318 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-b1833b1c-de9a-4d7b-9c40-b00703b191f4 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:31.645237 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b1833b1c-de9a-4d7b-9c40-b00703b191f4 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:31.645735 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b1833b1c-de9a-4d7b-9c40-b00703b191f4 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:31.646173 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b1833b1c-de9a-4d7b-9c40-b00703b191f4 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:31.646863 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b1833b1c-de9a-4d7b-9c40-b00703b191f4 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:31.647315 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b1833b1c-de9a-4d7b-9c40-b00703b191f4 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:31.647745 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b1833b1c-de9a-4d7b-9c40-b00703b191f4 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:31.820885 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-b1833b1c-de9a-4d7b-9c40-b00703b191f4 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:31.828592 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-b1833b1c-de9a-4d7b-9c40-b00703b191f4 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1576 microversion: 2.1 time: 0.194770 Aug 24 08:02:31.829182 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 391/785] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:31 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1576 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:32.850287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-7810504d-9a18-4bda-81d7-b1bbdc695462 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:32.850930 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-7810504d-9a18-4bda-81d7-b1bbdc695462 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:32.857517 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7810504d-9a18-4bda-81d7-b1bbdc695462 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:32.858002 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7810504d-9a18-4bda-81d7-b1bbdc695462 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:32.858436 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7810504d-9a18-4bda-81d7-b1bbdc695462 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:32.859131 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7810504d-9a18-4bda-81d7-b1bbdc695462 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:32.859585 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7810504d-9a18-4bda-81d7-b1bbdc695462 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:32.860009 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7810504d-9a18-4bda-81d7-b1bbdc695462 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:32.996156 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7810504d-9a18-4bda-81d7-b1bbdc695462 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:33.004210 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-7810504d-9a18-4bda-81d7-b1bbdc695462 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1576 microversion: 2.1 time: 0.158232 Aug 24 08:02:33.004809 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 395/786] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:32 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:34.027002 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-01216492-cebd-4903-bd93-c0a77d8af91f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:34.027677 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-01216492-cebd-4903-bd93-c0a77d8af91f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:34.034597 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-01216492-cebd-4903-bd93-c0a77d8af91f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:34.035204 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-01216492-cebd-4903-bd93-c0a77d8af91f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:34.035738 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-01216492-cebd-4903-bd93-c0a77d8af91f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:34.036447 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-01216492-cebd-4903-bd93-c0a77d8af91f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:34.036926 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-01216492-cebd-4903-bd93-c0a77d8af91f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:34.037353 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-01216492-cebd-4903-bd93-c0a77d8af91f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:34.230070 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-01216492-cebd-4903-bd93-c0a77d8af91f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:34.238796 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-01216492-cebd-4903-bd93-c0a77d8af91f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1576 microversion: 2.1 time: 0.215607 Aug 24 08:02:34.239370 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 392/787] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:34 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1576 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:35.259843 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-02dd1c97-da88-4918-83ae-6838e9a3df66 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:35.260449 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-02dd1c97-da88-4918-83ae-6838e9a3df66 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:35.271339 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-02dd1c97-da88-4918-83ae-6838e9a3df66 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:35.275644 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-02dd1c97-da88-4918-83ae-6838e9a3df66 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:35.275644 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-02dd1c97-da88-4918-83ae-6838e9a3df66 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:35.276188 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-02dd1c97-da88-4918-83ae-6838e9a3df66 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:35.276691 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-02dd1c97-da88-4918-83ae-6838e9a3df66 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:35.277107 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-02dd1c97-da88-4918-83ae-6838e9a3df66 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:35.448064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-02dd1c97-da88-4918-83ae-6838e9a3df66 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:35.457749 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-02dd1c97-da88-4918-83ae-6838e9a3df66 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1576 microversion: 2.1 time: 0.201245 Aug 24 08:02:35.458504 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 396/788] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:35 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1576 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:36.479706 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-14a001cb-75f6-4212-b41d-b297c6cb761a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:36.480399 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-14a001cb-75f6-4212-b41d-b297c6cb761a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:36.486821 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-14a001cb-75f6-4212-b41d-b297c6cb761a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:36.487362 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-14a001cb-75f6-4212-b41d-b297c6cb761a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:36.490105 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-14a001cb-75f6-4212-b41d-b297c6cb761a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:36.490105 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-14a001cb-75f6-4212-b41d-b297c6cb761a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:36.490105 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-14a001cb-75f6-4212-b41d-b297c6cb761a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:36.490105 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-14a001cb-75f6-4212-b41d-b297c6cb761a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:36.719506 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-14a001cb-75f6-4212-b41d-b297c6cb761a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:36.729788 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-14a001cb-75f6-4212-b41d-b297c6cb761a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1576 microversion: 2.1 time: 0.253992 Aug 24 08:02:36.730452 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 393/789] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:36 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1576 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:37.101068 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-6ff49c8a-4eb7-481e-8b2d-6f6fd29c3639 req-4046ba8c-8bb8-43e7-9cb5-e5e041593f2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce799f4-91d9-4521-af5d-63757a11823c", "name": "network-vif-plugged", "status": "completed", "tag": "b6e8c168-af88-483f-9e17-53d9c3c9d376"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:02:37.113744 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-6ff49c8a-4eb7-481e-8b2d-6f6fd29c3639 req-4046ba8c-8bb8-43e7-9cb5-e5e041593f2b service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:37.114319 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-6ff49c8a-4eb7-481e-8b2d-6f6fd29c3639 req-4046ba8c-8bb8-43e7-9cb5-e5e041593f2b service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:37.114763 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-6ff49c8a-4eb7-481e-8b2d-6f6fd29c3639 req-4046ba8c-8bb8-43e7-9cb5-e5e041593f2b service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:37.126853 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-6ff49c8a-4eb7-481e-8b2d-6f6fd29c3639 req-4046ba8c-8bb8-43e7-9cb5-e5e041593f2b service nova] Creating event network-vif-plugged:b6e8c168-af88-483f-9e17-53d9c3c9d376 for instance 3ce799f4-91d9-4521-af5d-63757a11823c on hv-cinder-85427 Aug 24 08:02:37.134569 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-6ff49c8a-4eb7-481e-8b2d-6f6fd29c3639 req-4046ba8c-8bb8-43e7-9cb5-e5e041593f2b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038522 Aug 24 08:02:37.135169 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 397/790] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:02:37.751053 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-fbb40e53-9692-40c4-b230-0231b636c4fe tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:37.751704 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-fbb40e53-9692-40c4-b230-0231b636c4fe tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:37.759134 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fbb40e53-9692-40c4-b230-0231b636c4fe tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:37.759629 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fbb40e53-9692-40c4-b230-0231b636c4fe tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:37.760090 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fbb40e53-9692-40c4-b230-0231b636c4fe tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:37.761089 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fbb40e53-9692-40c4-b230-0231b636c4fe tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:37.761532 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fbb40e53-9692-40c4-b230-0231b636c4fe tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:37.761958 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fbb40e53-9692-40c4-b230-0231b636c4fe tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:37.919535 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-fbb40e53-9692-40c4-b230-0231b636c4fe tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:37.929583 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-fbb40e53-9692-40c4-b230-0231b636c4fe tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1576 microversion: 2.1 time: 0.181538 Aug 24 08:02:37.929583 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 394/791] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:37 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:38.954072 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-cc41ced3-cf7c-48b3-9cb1-2423160f012f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:38.954864 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-cc41ced3-cf7c-48b3-9cb1-2423160f012f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:38.961367 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc41ced3-cf7c-48b3-9cb1-2423160f012f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:38.962172 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc41ced3-cf7c-48b3-9cb1-2423160f012f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:38.962810 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc41ced3-cf7c-48b3-9cb1-2423160f012f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:38.963846 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc41ced3-cf7c-48b3-9cb1-2423160f012f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:38.964288 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc41ced3-cf7c-48b3-9cb1-2423160f012f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:38.965307 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cc41ced3-cf7c-48b3-9cb1-2423160f012f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:39.111431 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-cc41ced3-cf7c-48b3-9cb1-2423160f012f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:39.120347 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-cc41ced3-cf7c-48b3-9cb1-2423160f012f tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1563 microversion: 2.1 time: 0.172155 Aug 24 08:02:39.120947 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 398/792] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:02:38 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1563 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:44.211519 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-5a151d74-9d67-46c9-b9af-93fa924cfff1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Action: 'create', calling method: .version_select at 0x7f320c1813a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-688278176", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDemibCj+tLjqzXDHmn1z6kgVKQogsyTZDugnJWzrwGcOQblvpCmom1jJOOJfeO82vVKfjfuyVSK72WkgyM0gjZ4CqmYXoD19RNrJQbYuqbFoYX45YEqyr7yCXQWOvNYA=="}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:02:44.227601 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-5a151d74-9d67-46c9-b9af-93fa924cfff1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Getting quotas for project 67da3e4c41e64947bb3e531c5b7550b6. Resources: {'key_pairs'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:02:44.231600 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-5a151d74-9d67-46c9-b9af-93fa924cfff1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Getting quotas for user 7a279965532e4020876954116f53d3b9 and project 67da3e4c41e64947bb3e531c5b7550b6. Resources: {'key_pairs'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:02:44.316849 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-5a151d74-9d67-46c9-b9af-93fa924cfff1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.281267 Aug 24 08:02:44.317654 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 395/793] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 24 08:02:44 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:02:51.458426 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-5c019b12-16c3-4eea-9bb0-0bedd02db368 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:51.460591 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-5c019b12-16c3-4eea-9bb0-0bedd02db368 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:51.462715 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=39 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:51.463381 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=59 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:51.467986 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c019b12-16c3-4eea-9bb0-0bedd02db368 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:51.468467 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c019b12-16c3-4eea-9bb0-0bedd02db368 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:51.468932 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c019b12-16c3-4eea-9bb0-0bedd02db368 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:51.469624 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c019b12-16c3-4eea-9bb0-0bedd02db368 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:51.470073 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c019b12-16c3-4eea-9bb0-0bedd02db368 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:51.470552 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c019b12-16c3-4eea-9bb0-0bedd02db368 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:51.501751 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-5c019b12-16c3-4eea-9bb0-0bedd02db368 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047324 Aug 24 08:02:51.502226 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 399/794] 10.222.0.72 () {60 vars in 1343 bytes} [Wed Aug 24 08:02:51 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:02:51.566709 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:51.571018 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-b50de86f-b5e1-4d65-abff-700bf8ccf42d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:51.571657 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-b50de86f-b5e1-4d65-abff-700bf8ccf42d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:51.573529 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:51.578948 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b50de86f-b5e1-4d65-abff-700bf8ccf42d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:51.579432 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b50de86f-b5e1-4d65-abff-700bf8ccf42d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:51.579872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b50de86f-b5e1-4d65-abff-700bf8ccf42d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:51.580759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b50de86f-b5e1-4d65-abff-700bf8ccf42d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:51.581114 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b50de86f-b5e1-4d65-abff-700bf8ccf42d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:51.581580 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b50de86f-b5e1-4d65-abff-700bf8ccf42d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:51.607175 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-b50de86f-b5e1-4d65-abff-700bf8ccf42d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Going to try to terminate instance {{(pid=127590) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:02:51.956061 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-b50de86f-b5e1-4d65-abff-700bf8ccf42d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "DELETE /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 204 len: 0 microversion: 2.20 time: 0.390487 Aug 24 08:02:51.956640 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 396/795] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 24 08:02:51 2022] DELETE /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 08:02:51.966201 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-2d0b2b9b-0ce7-4a42-919e-c86277bfc15f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:51.966996 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-2d0b2b9b-0ce7-4a42-919e-c86277bfc15f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:51.973750 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2d0b2b9b-0ce7-4a42-919e-c86277bfc15f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:51.974233 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2d0b2b9b-0ce7-4a42-919e-c86277bfc15f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:51.975307 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2d0b2b9b-0ce7-4a42-919e-c86277bfc15f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:51.976013 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2d0b2b9b-0ce7-4a42-919e-c86277bfc15f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:51.976494 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2d0b2b9b-0ce7-4a42-919e-c86277bfc15f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:51.976963 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2d0b2b9b-0ce7-4a42-919e-c86277bfc15f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:52.106757 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-2d0b2b9b-0ce7-4a42-919e-c86277bfc15f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:52.115036 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-2d0b2b9b-0ce7-4a42-919e-c86277bfc15f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:52.116541 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-2d0b2b9b-0ce7-4a42-919e-c86277bfc15f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:52.117725 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-2d0b2b9b-0ce7-4a42-919e-c86277bfc15f tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1723 microversion: 2.20 time: 0.155548 Aug 24 08:02:52.118277 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 400/796] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:02:51 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:02:53.143292 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-d2afbd97-6123-48f8-872c-37022148084d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:53.143992 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-d2afbd97-6123-48f8-872c-37022148084d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:53.150790 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d2afbd97-6123-48f8-872c-37022148084d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:53.151283 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d2afbd97-6123-48f8-872c-37022148084d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:53.151724 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d2afbd97-6123-48f8-872c-37022148084d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:53.152420 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d2afbd97-6123-48f8-872c-37022148084d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:53.152906 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d2afbd97-6123-48f8-872c-37022148084d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:53.153468 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d2afbd97-6123-48f8-872c-37022148084d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:53.286116 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-d2afbd97-6123-48f8-872c-37022148084d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:53.295241 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-d2afbd97-6123-48f8-872c-37022148084d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:53.296789 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-d2afbd97-6123-48f8-872c-37022148084d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:53.297946 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-d2afbd97-6123-48f8-872c-37022148084d tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1723 microversion: 2.20 time: 0.159316 Aug 24 08:02:53.298493 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 397/797] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:02:53 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:02:54.321980 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-7571e2d1-43c1-4ffe-b4bd-0c1c9d9c8f83 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:54.322596 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-7571e2d1-43c1-4ffe-b4bd-0c1c9d9c8f83 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:54.329641 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7571e2d1-43c1-4ffe-b4bd-0c1c9d9c8f83 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:54.330383 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7571e2d1-43c1-4ffe-b4bd-0c1c9d9c8f83 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:54.331001 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7571e2d1-43c1-4ffe-b4bd-0c1c9d9c8f83 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:54.331847 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7571e2d1-43c1-4ffe-b4bd-0c1c9d9c8f83 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:54.332202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7571e2d1-43c1-4ffe-b4bd-0c1c9d9c8f83 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:54.332635 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7571e2d1-43c1-4ffe-b4bd-0c1c9d9c8f83 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:54.453634 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7571e2d1-43c1-4ffe-b4bd-0c1c9d9c8f83 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:54.462002 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7571e2d1-43c1-4ffe-b4bd-0c1c9d9c8f83 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:54.463882 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7571e2d1-43c1-4ffe-b4bd-0c1c9d9c8f83 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:54.464789 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-7571e2d1-43c1-4ffe-b4bd-0c1c9d9c8f83 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1656 microversion: 2.20 time: 0.146916 Aug 24 08:02:54.465831 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 401/798] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:02:54 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1656 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:02:54.664506 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-ec6e5b69-0ac0-4ba4-b0dc-4ae7b472240d req-4891cbe1-c81a-472b-9b6f-2046ee7f1541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "771d249a-e50d-4848-b6ab-cb76685964d7", "name": "network-vif-deleted", "tag": "f4073395-cdc8-42de-89a0-3e684efbce28"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:02:54.673894 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=4 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:54.677991 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-ec6e5b69-0ac0-4ba4-b0dc-4ae7b472240d req-4891cbe1-c81a-472b-9b6f-2046ee7f1541 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:54.678635 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-ec6e5b69-0ac0-4ba4-b0dc-4ae7b472240d req-4891cbe1-c81a-472b-9b6f-2046ee7f1541 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:54.679086 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-ec6e5b69-0ac0-4ba4-b0dc-4ae7b472240d req-4891cbe1-c81a-472b-9b6f-2046ee7f1541 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:54.691093 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-ec6e5b69-0ac0-4ba4-b0dc-4ae7b472240d req-4891cbe1-c81a-472b-9b6f-2046ee7f1541 service nova] Creating event network-vif-deleted:f4073395-cdc8-42de-89a0-3e684efbce28 for instance 771d249a-e50d-4848-b6ab-cb76685964d7 on hv-cinder-85427 Aug 24 08:02:54.698098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-ec6e5b69-0ac0-4ba4-b0dc-4ae7b472240d req-4891cbe1-c81a-472b-9b6f-2046ee7f1541 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037934 Aug 24 08:02:54.698715 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 398/799] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:02:55.489433 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-52eeec04-3e92-46fe-a47c-4d75122fb152 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:55.490917 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-52eeec04-3e92-46fe-a47c-4d75122fb152 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:55.498178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-52eeec04-3e92-46fe-a47c-4d75122fb152 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:55.498669 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-52eeec04-3e92-46fe-a47c-4d75122fb152 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:55.499104 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-52eeec04-3e92-46fe-a47c-4d75122fb152 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:55.499848 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-52eeec04-3e92-46fe-a47c-4d75122fb152 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:55.500299 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-52eeec04-3e92-46fe-a47c-4d75122fb152 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:55.500841 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-52eeec04-3e92-46fe-a47c-4d75122fb152 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:55.536474 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-52eeec04-3e92-46fe-a47c-4d75122fb152 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:55.537014 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-52eeec04-3e92-46fe-a47c-4d75122fb152 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:55.537460 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-52eeec04-3e92-46fe-a47c-4d75122fb152 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:55.537917 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.objects.instance [None req-52eeec04-3e92-46fe-a47c-4d75122fb152 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lazy-loading 'fault' on Instance uuid 771d249a-e50d-4848-b6ab-cb76685964d7 {{(pid=127589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:02:55.581880 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-52eeec04-3e92-46fe-a47c-4d75122fb152 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:55.590535 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-52eeec04-3e92-46fe-a47c-4d75122fb152 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:55.592117 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-52eeec04-3e92-46fe-a47c-4d75122fb152 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd318793a5fee43bdb1a043b30396884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c8e372420a4076b855d46a4f8ff521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:02:55.593325 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-52eeec04-3e92-46fe-a47c-4d75122fb152 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 200 len: 1372 microversion: 2.20 time: 0.108372 Aug 24 08:02:55.593880 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 402/800] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:02:55 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:02:56.617448 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-5476088f-37be-4979-a03c-c8961a14b5e0 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:56.618196 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-5476088f-37be-4979-a03c-c8961a14b5e0 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:56.624536 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5476088f-37be-4979-a03c-c8961a14b5e0 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:56.625053 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5476088f-37be-4979-a03c-c8961a14b5e0 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:56.625485 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5476088f-37be-4979-a03c-c8961a14b5e0 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:56.626167 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5476088f-37be-4979-a03c-c8961a14b5e0 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:56.626611 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5476088f-37be-4979-a03c-c8961a14b5e0 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:56.627030 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5476088f-37be-4979-a03c-c8961a14b5e0 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:56.640929 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.wsgi [None req-5476088f-37be-4979-a03c-c8961a14b5e0 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] HTTP exception thrown: Instance 771d249a-e50d-4848-b6ab-cb76685964d7 could not be found. Aug 24 08:02:56.642598 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-5476088f-37be-4979-a03c-c8961a14b5e0 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Request method failure captured: Aug 24 08:02:56.642598 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: request: GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 HTTP/1.1 Aug 24 08:02:56.642598 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept: application/json Aug 24 08:02:56.642598 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept-Encoding: identity Aug 24 08:02:56.642598 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Connection: close Aug 24 08:02:56.642598 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Length: 0 Aug 24 08:02:56.642598 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Type: application/json Aug 24 08:02:56.642598 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Host: 10.222.0.72 Aug 24 08:02:56.642598 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Openstack-System-Scope: None Aug 24 08:02:56.642598 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: User-Agent: python-urllib3/1.26.11 Aug 24 08:02:56.642598 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Auth-Token: gAAAAABjBdl3cKStCm1Zlm946IP-OitNI5HL6KiJ_bhgRgPg58Easkt4DSp-7URwaFSBSjLAiKPQW0zOaKxelBjerZX7aKdzDYdpzLo0vYdbNyRxU1JeTRXQY6XHsyVrl0hBgC4KO8dvdovOPrkhjLqdnJJIEEDxrmUdrhdm1B1Av9eMoD5jzq0 Aug 24 08:02:56.642598 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Id: None Aug 24 08:02:56.642598 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Name: None Aug 24 08:02:56.642598 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Identity-Status: Confirmed Aug 24 08:02:56.642598 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Is-Admin-Project: True Aug 24 08:02:56.642598 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 08:02:56.642598 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Id: default Aug 24 08:02:56.642598 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Name: Default Aug 24 08:02:56.642598 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Id: 27c8e372420a4076b855d46a4f8ff521 Aug 24 08:02:56.642598 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-815520547 Aug 24 08:02:56.642598 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Role: reader,member Aug 24 08:02:56.642598 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Roles: reader,member Aug 24 08:02:56.644338 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_27c8e372420a4076b855d46a4f8ff521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/27c8e372420a4076b855d46a4f8ff521"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27c8e372420a4076b855d46a4f8ff521"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27c8e372420a4076b855d46a4f8ff521"}]}] Aug 24 08:02:56.644338 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant: tempest-AttachVolumeShelveTestJSON-815520547 Aug 24 08:02:56.644338 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Id: 27c8e372420a4076b855d46a4f8ff521 Aug 24 08:02:56.644338 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-815520547 Aug 24 08:02:56.644338 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User: tempest-AttachVolumeShelveTestJSON-815520547-project Aug 24 08:02:56.644338 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Id: default Aug 24 08:02:56.644338 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Name: Default Aug 24 08:02:56.644338 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Id: d318793a5fee43bdb1a043b30396884b Aug 24 08:02:56.644338 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Name: tempest-AttachVolumeShelveTestJSON-815520547-project Aug 24 08:02:56.644338 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: method: > Aug 24 08:02:56.644338 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: exception: Instance 771d249a-e50d-4848-b6ab-cb76685964d7 could not be found. Aug 24 08:02:56.644338 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: action_args: {'id': '771d249a-e50d-4848-b6ab-cb76685964d7'} Aug 24 08:02:56.645365 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:02:56.645365 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:56.645365 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:02:56.645365 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:02:56.645365 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:02:56.645365 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:02:56.645365 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:02:56.645365 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:02:56.645365 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:02:56.645365 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:02:56.645365 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 771d249a-e50d-4848-b6ab-cb76685964d7 could not be found. Aug 24 08:02:56.645365 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:02:56.645365 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:02:56.645365 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:02:56.645365 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:56.645365 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:02:56.645365 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:02:56.645365 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:02:56.645365 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:02:56.645365 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:02:56.647542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:02:56.647542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:02:56.647542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:02:56.647542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:02:56.647542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:02:56.647542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:02:56.647542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:02:56.647542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 771d249a-e50d-4848-b6ab-cb76685964d7 could not be found. Aug 24 08:02:56.647542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:02:56.647542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:02:56.647542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:02:56.647542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:56.647542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:02:56.647542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:02:56.647542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:02:56.647542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:02:56.647542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 771d249a-e50d-4848-b6ab-cb76685964d7 could not be found. Aug 24 08:02:56.647542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:02:56.649020 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-5476088f-37be-4979-a03c-c8961a14b5e0 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Returning 404 to user: Instance 771d249a-e50d-4848-b6ab-cb76685964d7 could not be found. {{(pid=127590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:02:56.649020 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-5476088f-37be-4979-a03c-c8961a14b5e0 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 404 len: 111 microversion: 2.20 time: 0.031768 Aug 24 08:02:56.649020 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 399/801] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:02:56 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 08:02:56.653641 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b5a03f26-847f-403e-9cb7-7c75b074f1b0 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '.version_select at 0x7f320c8d3af0>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:56.705872 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-b5a03f26-847f-403e-9cb7-7c75b074f1b0 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1906892412" status: 204 len: 0 microversion: 2.20 time: 0.055974 Aug 24 08:02:56.706477 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 403/802] 10.222.0.72 () {60 vars in 1262 bytes} [Wed Aug 24 08:02:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1906892412 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 08:02:58.808368 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-979a69fb-88a2-4bcc-9418-9e97f9bd0c9c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:58.809132 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-979a69fb-88a2-4bcc-9418-9e97f9bd0c9c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:58.815239 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-979a69fb-88a2-4bcc-9418-9e97f9bd0c9c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:58.815727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-979a69fb-88a2-4bcc-9418-9e97f9bd0c9c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:58.816172 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-979a69fb-88a2-4bcc-9418-9e97f9bd0c9c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:58.816905 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-979a69fb-88a2-4bcc-9418-9e97f9bd0c9c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:58.817364 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-979a69fb-88a2-4bcc-9418-9e97f9bd0c9c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:58.817790 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-979a69fb-88a2-4bcc-9418-9e97f9bd0c9c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:58.831024 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.wsgi [None req-979a69fb-88a2-4bcc-9418-9e97f9bd0c9c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] HTTP exception thrown: Instance 771d249a-e50d-4848-b6ab-cb76685964d7 could not be found. Aug 24 08:02:58.832541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-979a69fb-88a2-4bcc-9418-9e97f9bd0c9c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Request method failure captured: Aug 24 08:02:58.832541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: request: DELETE /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 HTTP/1.1 Aug 24 08:02:58.832541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept: application/json Aug 24 08:02:58.832541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept-Encoding: identity Aug 24 08:02:58.832541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Connection: close Aug 24 08:02:58.832541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Length: 0 Aug 24 08:02:58.832541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Type: application/json Aug 24 08:02:58.832541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Host: 10.222.0.72 Aug 24 08:02:58.832541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Openstack-System-Scope: None Aug 24 08:02:58.832541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: User-Agent: python-urllib3/1.26.11 Aug 24 08:02:58.832541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Auth-Token: gAAAAABjBdl3cKStCm1Zlm946IP-OitNI5HL6KiJ_bhgRgPg58Easkt4DSp-7URwaFSBSjLAiKPQW0zOaKxelBjerZX7aKdzDYdpzLo0vYdbNyRxU1JeTRXQY6XHsyVrl0hBgC4KO8dvdovOPrkhjLqdnJJIEEDxrmUdrhdm1B1Av9eMoD5jzq0 Aug 24 08:02:58.832541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Id: None Aug 24 08:02:58.832541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Name: None Aug 24 08:02:58.832541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Identity-Status: Confirmed Aug 24 08:02:58.832541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Is-Admin-Project: True Aug 24 08:02:58.832541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 08:02:58.832541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Id: default Aug 24 08:02:58.832541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Name: Default Aug 24 08:02:58.832541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Id: 27c8e372420a4076b855d46a4f8ff521 Aug 24 08:02:58.832541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-815520547 Aug 24 08:02:58.832541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Role: reader,member Aug 24 08:02:58.832541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Roles: reader,member Aug 24 08:02:58.834146 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_27c8e372420a4076b855d46a4f8ff521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/27c8e372420a4076b855d46a4f8ff521"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27c8e372420a4076b855d46a4f8ff521"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27c8e372420a4076b855d46a4f8ff521"}]}] Aug 24 08:02:58.834146 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant: tempest-AttachVolumeShelveTestJSON-815520547 Aug 24 08:02:58.834146 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Id: 27c8e372420a4076b855d46a4f8ff521 Aug 24 08:02:58.834146 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-815520547 Aug 24 08:02:58.834146 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User: tempest-AttachVolumeShelveTestJSON-815520547-project Aug 24 08:02:58.834146 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Id: default Aug 24 08:02:58.834146 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Name: Default Aug 24 08:02:58.834146 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Id: d318793a5fee43bdb1a043b30396884b Aug 24 08:02:58.834146 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Name: tempest-AttachVolumeShelveTestJSON-815520547-project Aug 24 08:02:58.834146 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: method: > Aug 24 08:02:58.834146 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: exception: Instance 771d249a-e50d-4848-b6ab-cb76685964d7 could not be found. Aug 24 08:02:58.834146 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: action_args: {'id': '771d249a-e50d-4848-b6ab-cb76685964d7'} Aug 24 08:02:58.835051 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:02:58.835051 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:58.835051 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:02:58.835051 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:02:58.835051 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:02:58.835051 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:02:58.835051 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:02:58.835051 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:02:58.835051 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:02:58.835051 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:02:58.835051 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 771d249a-e50d-4848-b6ab-cb76685964d7 could not be found. Aug 24 08:02:58.835051 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:02:58.835051 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:02:58.835051 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:02:58.835051 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:58.835051 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:02:58.835051 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:02:58.835051 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:02:58.835051 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:02:58.835051 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:02:58.836404 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:02:58.836404 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 08:02:58.836404 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 08:02:58.836404 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 08:02:58.836404 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 08:02:58.836404 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:02:58.836404 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:02:58.836404 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:02:58.836404 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:02:58.836404 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 771d249a-e50d-4848-b6ab-cb76685964d7 could not be found. Aug 24 08:02:58.836404 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:02:58.836404 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:02:58.836404 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:02:58.836404 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:58.836404 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:02:58.836404 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:02:58.836404 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:02:58.836404 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:02:58.836404 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 771d249a-e50d-4848-b6ab-cb76685964d7 could not be found. Aug 24 08:02:58.836404 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:02:58.837675 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-979a69fb-88a2-4bcc-9418-9e97f9bd0c9c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Returning 404 to user: Instance 771d249a-e50d-4848-b6ab-cb76685964d7 could not be found. {{(pid=127590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:02:58.837675 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-979a69fb-88a2-4bcc-9418-9e97f9bd0c9c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "DELETE /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 404 len: 111 microversion: 2.20 time: 0.029470 Aug 24 08:02:58.837675 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 400/803] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 24 08:02:58 2022] DELETE /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 08:02:58.843132 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-658ec6e4-917c-4d4f-8935-1cb453f9aefb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:02:58.843742 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-658ec6e4-917c-4d4f-8935-1cb453f9aefb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: 771d249a-e50d-4848-b6ab-cb76685964d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:02:58.851066 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-658ec6e4-917c-4d4f-8935-1cb453f9aefb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:58.851546 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-658ec6e4-917c-4d4f-8935-1cb453f9aefb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:58.851986 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-658ec6e4-917c-4d4f-8935-1cb453f9aefb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:58.852699 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-658ec6e4-917c-4d4f-8935-1cb453f9aefb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:02:58.853155 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-658ec6e4-917c-4d4f-8935-1cb453f9aefb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:02:58.853577 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-658ec6e4-917c-4d4f-8935-1cb453f9aefb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:02:58.866826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-658ec6e4-917c-4d4f-8935-1cb453f9aefb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] HTTP exception thrown: Instance 771d249a-e50d-4848-b6ab-cb76685964d7 could not be found. Aug 24 08:02:58.868440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-658ec6e4-917c-4d4f-8935-1cb453f9aefb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Request method failure captured: Aug 24 08:02:58.868440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 HTTP/1.1 Aug 24 08:02:58.868440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 08:02:58.868440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 08:02:58.868440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 08:02:58.868440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 08:02:58.868440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 08:02:58.868440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 08:02:58.868440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 08:02:58.868440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 08:02:58.868440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdl3cKStCm1Zlm946IP-OitNI5HL6KiJ_bhgRgPg58Easkt4DSp-7URwaFSBSjLAiKPQW0zOaKxelBjerZX7aKdzDYdpzLo0vYdbNyRxU1JeTRXQY6XHsyVrl0hBgC4KO8dvdovOPrkhjLqdnJJIEEDxrmUdrhdm1B1Av9eMoD5jzq0 Aug 24 08:02:58.868440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 08:02:58.868440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 08:02:58.868440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 08:02:58.868440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 08:02:58.868440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 08:02:58.868440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 08:02:58.868440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 08:02:58.868440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: 27c8e372420a4076b855d46a4f8ff521 Aug 24 08:02:58.868440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-815520547 Aug 24 08:02:58.868440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 08:02:58.868440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 08:02:58.870062 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_27c8e372420a4076b855d46a4f8ff521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/27c8e372420a4076b855d46a4f8ff521"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27c8e372420a4076b855d46a4f8ff521"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27c8e372420a4076b855d46a4f8ff521"}]}] Aug 24 08:02:58.870062 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-AttachVolumeShelveTestJSON-815520547 Aug 24 08:02:58.870062 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: 27c8e372420a4076b855d46a4f8ff521 Aug 24 08:02:58.870062 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-815520547 Aug 24 08:02:58.870062 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-AttachVolumeShelveTestJSON-815520547-project Aug 24 08:02:58.870062 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 08:02:58.870062 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 08:02:58.870062 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: d318793a5fee43bdb1a043b30396884b Aug 24 08:02:58.870062 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-AttachVolumeShelveTestJSON-815520547-project Aug 24 08:02:58.870062 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 08:02:58.870062 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Instance 771d249a-e50d-4848-b6ab-cb76685964d7 could not be found. Aug 24 08:02:58.870062 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': '771d249a-e50d-4848-b6ab-cb76685964d7'} Aug 24 08:02:58.870874 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:02:58.870874 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:58.870874 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:02:58.870874 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:02:58.870874 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:02:58.870874 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:02:58.870874 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:02:58.870874 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:02:58.870874 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:02:58.870874 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:02:58.870874 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 771d249a-e50d-4848-b6ab-cb76685964d7 could not be found. Aug 24 08:02:58.870874 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:02:58.870874 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:02:58.870874 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:02:58.870874 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:58.870874 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:02:58.870874 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:02:58.870874 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:02:58.870874 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:02:58.870874 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:02:58.872070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:02:58.872070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:02:58.872070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:02:58.872070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:02:58.872070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:02:58.872070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:02:58.872070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:02:58.872070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 771d249a-e50d-4848-b6ab-cb76685964d7 could not be found. Aug 24 08:02:58.872070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:02:58.872070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:02:58.872070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:02:58.872070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:02:58.872070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:02:58.872070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:02:58.872070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:02:58.872070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:02:58.872070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 771d249a-e50d-4848-b6ab-cb76685964d7 could not be found. Aug 24 08:02:58.872070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:02:58.873172 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-658ec6e4-917c-4d4f-8935-1cb453f9aefb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Returning 404 to user: Instance 771d249a-e50d-4848-b6ab-cb76685964d7 could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:02:58.873172 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-658ec6e4-917c-4d4f-8935-1cb453f9aefb tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7" status: 404 len: 111 microversion: 2.20 time: 0.031168 Aug 24 08:02:58.873172 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 404/804] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:02:58 2022] GET /compute/v2.1/servers/771d249a-e50d-4848-b6ab-cb76685964d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 08:03:00.133904 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-d89bcf3c-2826-48b8-8404-3367ae18ff05 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:00.134390 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-d89bcf3c-2826-48b8-8404-3367ae18ff05 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:00.140762 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d89bcf3c-2826-48b8-8404-3367ae18ff05 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:00.141250 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d89bcf3c-2826-48b8-8404-3367ae18ff05 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:00.141684 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d89bcf3c-2826-48b8-8404-3367ae18ff05 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:00.142381 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d89bcf3c-2826-48b8-8404-3367ae18ff05 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:00.142838 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d89bcf3c-2826-48b8-8404-3367ae18ff05 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:00.143265 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d89bcf3c-2826-48b8-8404-3367ae18ff05 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:00.158817 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.wsgi [None req-d89bcf3c-2826-48b8-8404-3367ae18ff05 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] HTTP exception thrown: Instance a266e179-03cc-40b3-902d-aab680174711 could not be found. Aug 24 08:03:00.160343 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-d89bcf3c-2826-48b8-8404-3367ae18ff05 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Request method failure captured: Aug 24 08:03:00.160343 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: request: DELETE /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 HTTP/1.1 Aug 24 08:03:00.160343 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept: application/json Aug 24 08:03:00.160343 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept-Encoding: identity Aug 24 08:03:00.160343 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Connection: close Aug 24 08:03:00.160343 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Length: 0 Aug 24 08:03:00.160343 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Type: application/json Aug 24 08:03:00.160343 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Host: 10.222.0.72 Aug 24 08:03:00.160343 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Openstack-System-Scope: None Aug 24 08:03:00.160343 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: User-Agent: python-urllib3/1.26.11 Aug 24 08:03:00.160343 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Auth-Token: gAAAAABjBdl3cKStCm1Zlm946IP-OitNI5HL6KiJ_bhgRgPg58Easkt4DSp-7URwaFSBSjLAiKPQW0zOaKxelBjerZX7aKdzDYdpzLo0vYdbNyRxU1JeTRXQY6XHsyVrl0hBgC4KO8dvdovOPrkhjLqdnJJIEEDxrmUdrhdm1B1Av9eMoD5jzq0 Aug 24 08:03:00.160343 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Id: None Aug 24 08:03:00.160343 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Name: None Aug 24 08:03:00.160343 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Identity-Status: Confirmed Aug 24 08:03:00.160343 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Is-Admin-Project: True Aug 24 08:03:00.160343 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 08:03:00.160343 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Id: default Aug 24 08:03:00.160343 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Name: Default Aug 24 08:03:00.160343 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Id: 27c8e372420a4076b855d46a4f8ff521 Aug 24 08:03:00.160343 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-815520547 Aug 24 08:03:00.160343 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Role: reader,member Aug 24 08:03:00.160343 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Roles: reader,member Aug 24 08:03:00.161980 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_27c8e372420a4076b855d46a4f8ff521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/27c8e372420a4076b855d46a4f8ff521"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27c8e372420a4076b855d46a4f8ff521"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27c8e372420a4076b855d46a4f8ff521"}]}] Aug 24 08:03:00.161980 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant: tempest-AttachVolumeShelveTestJSON-815520547 Aug 24 08:03:00.161980 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Id: 27c8e372420a4076b855d46a4f8ff521 Aug 24 08:03:00.161980 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-815520547 Aug 24 08:03:00.161980 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User: tempest-AttachVolumeShelveTestJSON-815520547-project Aug 24 08:03:00.161980 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Id: default Aug 24 08:03:00.161980 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Name: Default Aug 24 08:03:00.161980 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Id: d318793a5fee43bdb1a043b30396884b Aug 24 08:03:00.161980 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Name: tempest-AttachVolumeShelveTestJSON-815520547-project Aug 24 08:03:00.161980 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: method: > Aug 24 08:03:00.161980 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: exception: Instance a266e179-03cc-40b3-902d-aab680174711 could not be found. Aug 24 08:03:00.161980 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: action_args: {'id': 'a266e179-03cc-40b3-902d-aab680174711'} Aug 24 08:03:00.162846 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:03:00.162846 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:03:00.162846 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:03:00.162846 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:03:00.162846 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:03:00.162846 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:03:00.162846 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:03:00.162846 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:03:00.162846 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:03:00.162846 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:03:00.162846 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a266e179-03cc-40b3-902d-aab680174711 could not be found. Aug 24 08:03:00.162846 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:03:00.162846 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:03:00.162846 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:03:00.162846 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:03:00.162846 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:03:00.162846 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:03:00.162846 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:03:00.162846 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:03:00.162846 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:03:00.164256 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:03:00.164256 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 08:03:00.164256 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 08:03:00.164256 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 08:03:00.164256 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 08:03:00.164256 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:03:00.164256 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:03:00.164256 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:03:00.164256 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:03:00.164256 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a266e179-03cc-40b3-902d-aab680174711 could not be found. Aug 24 08:03:00.164256 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:03:00.164256 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:03:00.164256 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:03:00.164256 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:03:00.164256 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:03:00.164256 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:03:00.164256 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:03:00.164256 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:03:00.164256 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a266e179-03cc-40b3-902d-aab680174711 could not be found. Aug 24 08:03:00.164256 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:03:00.165726 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-d89bcf3c-2826-48b8-8404-3367ae18ff05 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Returning 404 to user: Instance a266e179-03cc-40b3-902d-aab680174711 could not be found. {{(pid=127590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:03:00.165726 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-d89bcf3c-2826-48b8-8404-3367ae18ff05 tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 404 len: 111 microversion: 2.20 time: 0.032367 Aug 24 08:03:00.165726 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 401/805] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 24 08:03:00 2022] DELETE /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 08:03:00.170096 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-0bd9197f-2501-4536-beec-dccfef4bda0c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:00.170746 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-0bd9197f-2501-4536-beec-dccfef4bda0c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] [instance: a266e179-03cc-40b3-902d-aab680174711] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:00.177136 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0bd9197f-2501-4536-beec-dccfef4bda0c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:00.177622 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0bd9197f-2501-4536-beec-dccfef4bda0c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:00.178063 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0bd9197f-2501-4536-beec-dccfef4bda0c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:00.179271 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0bd9197f-2501-4536-beec-dccfef4bda0c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:00.179732 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0bd9197f-2501-4536-beec-dccfef4bda0c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:00.180158 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0bd9197f-2501-4536-beec-dccfef4bda0c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:00.193196 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-0bd9197f-2501-4536-beec-dccfef4bda0c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] HTTP exception thrown: Instance a266e179-03cc-40b3-902d-aab680174711 could not be found. Aug 24 08:03:00.195365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-0bd9197f-2501-4536-beec-dccfef4bda0c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Request method failure captured: Aug 24 08:03:00.195365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 HTTP/1.1 Aug 24 08:03:00.195365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 08:03:00.195365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 08:03:00.195365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 08:03:00.195365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 08:03:00.195365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 08:03:00.195365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 08:03:00.195365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 08:03:00.195365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 08:03:00.195365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdl3cKStCm1Zlm946IP-OitNI5HL6KiJ_bhgRgPg58Easkt4DSp-7URwaFSBSjLAiKPQW0zOaKxelBjerZX7aKdzDYdpzLo0vYdbNyRxU1JeTRXQY6XHsyVrl0hBgC4KO8dvdovOPrkhjLqdnJJIEEDxrmUdrhdm1B1Av9eMoD5jzq0 Aug 24 08:03:00.195365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 08:03:00.195365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 08:03:00.195365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 08:03:00.195365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 08:03:00.195365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 08:03:00.195365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 08:03:00.195365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 08:03:00.195365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: 27c8e372420a4076b855d46a4f8ff521 Aug 24 08:03:00.195365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-815520547 Aug 24 08:03:00.195365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 08:03:00.195365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 08:03:00.197202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_27c8e372420a4076b855d46a4f8ff521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/27c8e372420a4076b855d46a4f8ff521"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27c8e372420a4076b855d46a4f8ff521"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27c8e372420a4076b855d46a4f8ff521"}]}] Aug 24 08:03:00.197202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-AttachVolumeShelveTestJSON-815520547 Aug 24 08:03:00.197202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: 27c8e372420a4076b855d46a4f8ff521 Aug 24 08:03:00.197202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-815520547 Aug 24 08:03:00.197202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-AttachVolumeShelveTestJSON-815520547-project Aug 24 08:03:00.197202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 08:03:00.197202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 08:03:00.197202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: d318793a5fee43bdb1a043b30396884b Aug 24 08:03:00.197202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-AttachVolumeShelveTestJSON-815520547-project Aug 24 08:03:00.197202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 08:03:00.197202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Instance a266e179-03cc-40b3-902d-aab680174711 could not be found. Aug 24 08:03:00.197202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': 'a266e179-03cc-40b3-902d-aab680174711'} Aug 24 08:03:00.198070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:03:00.198070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:03:00.198070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:03:00.198070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:03:00.198070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:03:00.198070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:03:00.198070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:03:00.198070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:03:00.198070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:03:00.198070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:03:00.198070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a266e179-03cc-40b3-902d-aab680174711 could not be found. Aug 24 08:03:00.198070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:03:00.198070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:03:00.198070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:03:00.198070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:03:00.198070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:03:00.198070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:03:00.198070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:03:00.198070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:03:00.198070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:03:00.199458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:03:00.199458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:03:00.199458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:03:00.199458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:03:00.199458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:03:00.199458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:03:00.199458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:03:00.199458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a266e179-03cc-40b3-902d-aab680174711 could not be found. Aug 24 08:03:00.199458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:03:00.199458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:03:00.199458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:03:00.199458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:03:00.199458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:03:00.199458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:03:00.199458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:03:00.199458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:03:00.199458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a266e179-03cc-40b3-902d-aab680174711 could not be found. Aug 24 08:03:00.199458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:03:00.200756 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-0bd9197f-2501-4536-beec-dccfef4bda0c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] Returning 404 to user: Instance a266e179-03cc-40b3-902d-aab680174711 could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:03:00.200756 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-0bd9197f-2501-4536-beec-dccfef4bda0c tempest-AttachVolumeShelveTestJSON-815520547 tempest-AttachVolumeShelveTestJSON-815520547-project] 10.222.0.72 "GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711" status: 404 len: 111 microversion: 2.20 time: 0.030552 Aug 24 08:03:00.200756 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 405/806] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 24 08:03:00 2022] GET /compute/v2.1/servers/a266e179-03cc-40b3-902d-aab680174711 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 08:03:03.664912 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-9dcf01bc-9a39-4950-87b2-d0ca8c14bb52 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-729852197", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-688278176", "security_groups": [{"name": "tempest-secgroup-smoke-812161139"}], "block_device_mapping_v2": [{"uuid": "2dcec48b-5647-4098-a409-b62c3abc3089", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ba35002a-baf9-48c9-8bd5-ed065d35dab0"}]}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:03:03.797836 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.network.neutron [None req-9dcf01bc-9a39-4950-87b2-d0ca8c14bb52 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] validate_networks() for [('ba35002a-baf9-48c9-8bd5-ed065d35dab0', None, None, None, None, None)] {{(pid=127590) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:03:04.257416 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-9dcf01bc-9a39-4950-87b2-d0ca8c14bb52 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Flavor limits 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:03:04.257835 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-9dcf01bc-9a39-4950-87b2-d0ca8c14bb52 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Image limits 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:03:04.258317 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-9dcf01bc-9a39-4950-87b2-d0ca8c14bb52 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Flavor pref 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:03:04.258976 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-9dcf01bc-9a39-4950-87b2-d0ca8c14bb52 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Image pref 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:03:04.259471 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-9dcf01bc-9a39-4950-87b2-d0ca8c14bb52 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:03:04.268779 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9dcf01bc-9a39-4950-87b2-d0ca8c14bb52 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:04.269500 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9dcf01bc-9a39-4950-87b2-d0ca8c14bb52 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:04.269937 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9dcf01bc-9a39-4950-87b2-d0ca8c14bb52 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:04.271547 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9dcf01bc-9a39-4950-87b2-d0ca8c14bb52 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:04.271547 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9dcf01bc-9a39-4950-87b2-d0ca8c14bb52 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:04.271547 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9dcf01bc-9a39-4950-87b2-d0ca8c14bb52 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:04.293138 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-9dcf01bc-9a39-4950-87b2-d0ca8c14bb52 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Getting quotas for project 67da3e4c41e64947bb3e531c5b7550b6. Resources: {'cores', 'instances', 'ram'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:03:04.297304 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-9dcf01bc-9a39-4950-87b2-d0ca8c14bb52 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Getting quotas for user 7a279965532e4020876954116f53d3b9 and project 67da3e4c41e64947bb3e531c5b7550b6. Resources: {'cores', 'instances', 'ram'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:03:04.365156 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-9dcf01bc-9a39-4950-87b2-d0ca8c14bb52 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Going to run 1 instances... {{(pid=127590) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:03:04.367776 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-9dcf01bc-9a39-4950-87b2-d0ca8c14bb52 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: a2a5c24f-2c38-49f9-b39c-ee1ee740e884] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2dcec48b-5647-4098-a409-b62c3abc3089',volume_size=None,volume_type=None)] {{(pid=127590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:03:04.833178 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-9dcf01bc-9a39-4950-87b2-d0ca8c14bb52 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.172651 Aug 24 08:03:04.838899 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 402/807] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 24 08:03:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 08:03:04.845386 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-ef6bb132-a0d3-46ab-b719-7e0b573fcf33 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:04.845981 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-ef6bb132-a0d3-46ab-b719-7e0b573fcf33 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: a2a5c24f-2c38-49f9-b39c-ee1ee740e884] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:04.920730 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-ef6bb132-a0d3-46ab-b719-7e0b573fcf33 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:04.933403 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-ef6bb132-a0d3-46ab-b719-7e0b573fcf33 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884" status: 200 len: 1093 microversion: 2.1 time: 0.092246 Aug 24 08:03:04.934095 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 406/808] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:04 2022] GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884 => generated 1093 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:03:05.955444 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-e037e878-782c-48ab-b783-e849c62e8021 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:05.956068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-e037e878-782c-48ab-b783-e849c62e8021 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: a2a5c24f-2c38-49f9-b39c-ee1ee740e884] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:06.018655 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-e037e878-782c-48ab-b783-e849c62e8021 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:06.026638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-e037e878-782c-48ab-b783-e849c62e8021 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884" status: 200 len: 1093 microversion: 2.1 time: 0.075685 Aug 24 08:03:06.027369 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 403/809] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:05 2022] GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884 => generated 1093 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:07.050276 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-41ef086e-33d4-45d7-bf81-afa647f11c3a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:07.051171 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-41ef086e-33d4-45d7-bf81-afa647f11c3a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: a2a5c24f-2c38-49f9-b39c-ee1ee740e884] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:07.068119 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-41ef086e-33d4-45d7-bf81-afa647f11c3a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:07.068119 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-41ef086e-33d4-45d7-bf81-afa647f11c3a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:07.068119 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-41ef086e-33d4-45d7-bf81-afa647f11c3a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:07.068119 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-41ef086e-33d4-45d7-bf81-afa647f11c3a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:07.068462 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-41ef086e-33d4-45d7-bf81-afa647f11c3a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:07.068462 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-41ef086e-33d4-45d7-bf81-afa647f11c3a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:07.138048 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-41ef086e-33d4-45d7-bf81-afa647f11c3a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:07.146068 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-41ef086e-33d4-45d7-bf81-afa647f11c3a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884" status: 200 len: 1191 microversion: 2.1 time: 0.099759 Aug 24 08:03:07.146836 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 407/810] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:07 2022] GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884 => generated 1191 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:03:08.168057 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-2ab4aaf6-455e-49e8-a164-d0914237e846 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:08.168851 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-2ab4aaf6-455e-49e8-a164-d0914237e846 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: a2a5c24f-2c38-49f9-b39c-ee1ee740e884] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:08.176793 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2ab4aaf6-455e-49e8-a164-d0914237e846 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:08.177967 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2ab4aaf6-455e-49e8-a164-d0914237e846 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:08.178655 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2ab4aaf6-455e-49e8-a164-d0914237e846 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:08.180070 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2ab4aaf6-455e-49e8-a164-d0914237e846 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:08.180752 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2ab4aaf6-455e-49e8-a164-d0914237e846 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:08.181448 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2ab4aaf6-455e-49e8-a164-d0914237e846 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:08.369212 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-2ab4aaf6-455e-49e8-a164-d0914237e846 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:08.379211 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-2ab4aaf6-455e-49e8-a164-d0914237e846 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884" status: 200 len: 1276 microversion: 2.1 time: 0.215623 Aug 24 08:03:08.386827 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 404/811] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:08 2022] GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884 => generated 1276 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:09.404230 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-c632b34d-127f-44bf-8350-6bb57ab928b1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:09.404955 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-c632b34d-127f-44bf-8350-6bb57ab928b1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: a2a5c24f-2c38-49f9-b39c-ee1ee740e884] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:09.418355 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c632b34d-127f-44bf-8350-6bb57ab928b1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:09.419280 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c632b34d-127f-44bf-8350-6bb57ab928b1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:09.420021 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c632b34d-127f-44bf-8350-6bb57ab928b1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:09.421075 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c632b34d-127f-44bf-8350-6bb57ab928b1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:09.421939 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c632b34d-127f-44bf-8350-6bb57ab928b1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:09.422907 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c632b34d-127f-44bf-8350-6bb57ab928b1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:09.597996 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-c632b34d-127f-44bf-8350-6bb57ab928b1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:09.607096 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-c632b34d-127f-44bf-8350-6bb57ab928b1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884" status: 200 len: 1264 microversion: 2.1 time: 0.208394 Aug 24 08:03:09.607664 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 408/812] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:09 2022] GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884 => generated 1264 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:09.738924 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-313c653f-42c2-4bf8-8f1e-c698cf677a43 req-2919aae6-0509-4ede-b335-9b4a593e890e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2a5c24f-2c38-49f9-b39c-ee1ee740e884", "tag": "68223bf4-fae5-411c-b20b-32c5a0298520"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:03:09.751180 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-313c653f-42c2-4bf8-8f1e-c698cf677a43 req-2919aae6-0509-4ede-b335-9b4a593e890e service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:09.751737 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-313c653f-42c2-4bf8-8f1e-c698cf677a43 req-2919aae6-0509-4ede-b335-9b4a593e890e service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:09.752583 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-313c653f-42c2-4bf8-8f1e-c698cf677a43 req-2919aae6-0509-4ede-b335-9b4a593e890e service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:09.771884 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-313c653f-42c2-4bf8-8f1e-c698cf677a43 req-2919aae6-0509-4ede-b335-9b4a593e890e service nova] Creating event network-changed:68223bf4-fae5-411c-b20b-32c5a0298520 for instance a2a5c24f-2c38-49f9-b39c-ee1ee740e884 on hv-cinder-85427 Aug 24 08:03:09.777368 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-313c653f-42c2-4bf8-8f1e-c698cf677a43 req-2919aae6-0509-4ede-b335-9b4a593e890e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044150 Aug 24 08:03:09.778186 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 405/813] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:03:10.631470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-802ee56d-0a14-44db-b7b1-691719cced57 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:10.632644 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-802ee56d-0a14-44db-b7b1-691719cced57 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: a2a5c24f-2c38-49f9-b39c-ee1ee740e884] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:10.639042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-802ee56d-0a14-44db-b7b1-691719cced57 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:10.639536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-802ee56d-0a14-44db-b7b1-691719cced57 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:10.639979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-802ee56d-0a14-44db-b7b1-691719cced57 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:10.640706 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-802ee56d-0a14-44db-b7b1-691719cced57 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:10.641169 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-802ee56d-0a14-44db-b7b1-691719cced57 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:10.641601 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-802ee56d-0a14-44db-b7b1-691719cced57 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:10.951107 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-802ee56d-0a14-44db-b7b1-691719cced57 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:10.958896 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-802ee56d-0a14-44db-b7b1-691719cced57 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884" status: 200 len: 1264 microversion: 2.1 time: 0.331384 Aug 24 08:03:10.959672 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 409/814] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:10 2022] GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884 => generated 1264 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:11.981308 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-b1c40b9b-ae3f-42e4-97ce-9c84f81e3ce9 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:11.982428 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-b1c40b9b-ae3f-42e4-97ce-9c84f81e3ce9 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: a2a5c24f-2c38-49f9-b39c-ee1ee740e884] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:11.988879 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b1c40b9b-ae3f-42e4-97ce-9c84f81e3ce9 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:11.989742 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b1c40b9b-ae3f-42e4-97ce-9c84f81e3ce9 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:11.990240 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b1c40b9b-ae3f-42e4-97ce-9c84f81e3ce9 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:11.990948 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b1c40b9b-ae3f-42e4-97ce-9c84f81e3ce9 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:11.991701 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b1c40b9b-ae3f-42e4-97ce-9c84f81e3ce9 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:11.992275 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b1c40b9b-ae3f-42e4-97ce-9c84f81e3ce9 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:12.148063 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-b1c40b9b-ae3f-42e4-97ce-9c84f81e3ce9 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:12.156176 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-b1c40b9b-ae3f-42e4-97ce-9c84f81e3ce9 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884" status: 200 len: 1264 microversion: 2.1 time: 0.180248 Aug 24 08:03:12.156757 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 406/815] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:11 2022] GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:13.177419 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-6765118f-b2ce-4592-828b-8b2849d47958 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:13.178042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-6765118f-b2ce-4592-828b-8b2849d47958 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: a2a5c24f-2c38-49f9-b39c-ee1ee740e884] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:13.184377 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6765118f-b2ce-4592-828b-8b2849d47958 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:13.184902 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6765118f-b2ce-4592-828b-8b2849d47958 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:13.185349 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6765118f-b2ce-4592-828b-8b2849d47958 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:13.186064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6765118f-b2ce-4592-828b-8b2849d47958 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:13.186521 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6765118f-b2ce-4592-828b-8b2849d47958 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:13.186950 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6765118f-b2ce-4592-828b-8b2849d47958 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:13.336607 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-6765118f-b2ce-4592-828b-8b2849d47958 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:13.345003 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-6765118f-b2ce-4592-828b-8b2849d47958 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884" status: 200 len: 1264 microversion: 2.1 time: 0.171350 Aug 24 08:03:13.356790 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 410/816] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:13 2022] GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:13.481884 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-ba43c857-6fc7-4f8b-a987-5a820f9224bd tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Action: 'create', calling method: .version_select at 0x7f320c288b80>, body: {"keypair": {"name": "tempest-keypair-1107865553", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFJrZ9qpHpTCI1yp0xiyaIyNWr8BT0sjAAiin0MyUxM+17lVbvlHwCvFIPCbvTI6Clwd+EG9LsbgEU1gM9TsakeAvS7wbdMtzVG3daxpk+DIfIlaJgkGwmVa1WVFUFRQA=="}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:03:13.498411 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-ba43c857-6fc7-4f8b-a987-5a820f9224bd tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Getting quotas for project ef79c9df5a2541afaeff1a82b3e4a496. Resources: {'key_pairs'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:03:13.502602 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-ba43c857-6fc7-4f8b-a987-5a820f9224bd tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Getting quotas for user a590d584ed654ca399875a5e04a57a24 and project ef79c9df5a2541afaeff1a82b3e4a496. Resources: {'key_pairs'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:03:13.603302 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-ba43c857-6fc7-4f8b-a987-5a820f9224bd tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.244376 Aug 24 08:03:13.606503 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 407/817] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 24 08:03:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:03:14.367132 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-105940d4-14f6-4a8a-9ae4-95c02d8a4362 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:14.367759 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-105940d4-14f6-4a8a-9ae4-95c02d8a4362 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: a2a5c24f-2c38-49f9-b39c-ee1ee740e884] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:14.374206 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-105940d4-14f6-4a8a-9ae4-95c02d8a4362 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:14.374696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-105940d4-14f6-4a8a-9ae4-95c02d8a4362 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:14.375140 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-105940d4-14f6-4a8a-9ae4-95c02d8a4362 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:14.375841 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-105940d4-14f6-4a8a-9ae4-95c02d8a4362 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:14.376405 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-105940d4-14f6-4a8a-9ae4-95c02d8a4362 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:14.381653 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-105940d4-14f6-4a8a-9ae4-95c02d8a4362 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:14.533481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-105940d4-14f6-4a8a-9ae4-95c02d8a4362 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:14.543549 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-105940d4-14f6-4a8a-9ae4-95c02d8a4362 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884" status: 200 len: 1264 microversion: 2.1 time: 0.180592 Aug 24 08:03:14.551561 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 411/818] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:14 2022] GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884 => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:15.565297 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-dbaba787-772e-496b-8380-227002ca1b5f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:15.567545 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-dbaba787-772e-496b-8380-227002ca1b5f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: a2a5c24f-2c38-49f9-b39c-ee1ee740e884] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:15.572411 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=2 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:15.580760 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dbaba787-772e-496b-8380-227002ca1b5f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:15.581507 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dbaba787-772e-496b-8380-227002ca1b5f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:15.583574 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dbaba787-772e-496b-8380-227002ca1b5f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:15.584833 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dbaba787-772e-496b-8380-227002ca1b5f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:15.586071 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dbaba787-772e-496b-8380-227002ca1b5f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:15.587293 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dbaba787-772e-496b-8380-227002ca1b5f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:15.808164 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-dbaba787-772e-496b-8380-227002ca1b5f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:15.817628 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-dbaba787-772e-496b-8380-227002ca1b5f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884" status: 200 len: 1264 microversion: 2.1 time: 0.257088 Aug 24 08:03:15.823650 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 408/819] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:15 2022] GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884 => generated 1264 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:15.978896 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-3220069a-03bb-4c82-9989-86ee7322611e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-193383796", "imageRef": "ccdab334-55ce-4ff5-bd97-5a424660c282", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41e052c0-6ffd-41bd-913f-82327ff6b46b"}], "security_groups": [{"name": "tempest-securitygroup--418442109"}], "key_name": "tempest-keypair-1107865553", "user_data": "}} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:03:15.987056 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=2 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:16.098920 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.network.neutron [None req-3220069a-03bb-4c82-9989-86ee7322611e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] validate_networks() for [('41e052c0-6ffd-41bd-913f-82327ff6b46b', None, None, None, None, None)] {{(pid=127589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:03:16.538759 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-3220069a-03bb-4c82-9989-86ee7322611e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Flavor limits 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:03:16.538920 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-3220069a-03bb-4c82-9989-86ee7322611e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Image limits 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:03:16.539322 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-3220069a-03bb-4c82-9989-86ee7322611e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Flavor pref 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:03:16.539726 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-3220069a-03bb-4c82-9989-86ee7322611e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Image pref 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:03:16.540162 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-3220069a-03bb-4c82-9989-86ee7322611e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:03:16.548870 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3220069a-03bb-4c82-9989-86ee7322611e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:16.549348 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3220069a-03bb-4c82-9989-86ee7322611e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:16.549776 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3220069a-03bb-4c82-9989-86ee7322611e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:16.550494 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3220069a-03bb-4c82-9989-86ee7322611e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:16.550942 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3220069a-03bb-4c82-9989-86ee7322611e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:16.551364 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3220069a-03bb-4c82-9989-86ee7322611e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:16.567987 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.quota [None req-3220069a-03bb-4c82-9989-86ee7322611e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Getting quotas for project ef79c9df5a2541afaeff1a82b3e4a496. Resources: {'cores', 'instances', 'ram'} {{(pid=127589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:03:16.572771 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.quota [None req-3220069a-03bb-4c82-9989-86ee7322611e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Getting quotas for user a590d584ed654ca399875a5e04a57a24 and project ef79c9df5a2541afaeff1a82b3e4a496. Resources: {'cores', 'instances', 'ram'} {{(pid=127589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:03:16.584262 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-3220069a-03bb-4c82-9989-86ee7322611e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Going to run 1 instances... {{(pid=127589) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:03:16.586641 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-3220069a-03bb-4c82-9989-86ee7322611e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccdab334-55ce-4ff5-bd97-5a424660c282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:03:16.733764 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-3220069a-03bb-4c82-9989-86ee7322611e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.759643 Aug 24 08:03:16.734317 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 412/820] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 24 08:03:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 08:03:16.746140 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-48699ccd-0a56-44c6-8368-d8220030dcee tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:16.746869 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-48699ccd-0a56-44c6-8368-d8220030dcee tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:16.802743 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-48699ccd-0a56-44c6-8368-d8220030dcee tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:16.810126 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-48699ccd-0a56-44c6-8368-d8220030dcee tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1237 microversion: 2.1 time: 0.068702 Aug 24 08:03:16.810695 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 409/821] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:16 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:16.838545 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-45faf5b6-f486-4a79-b930-d55a487cb031 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:16.839170 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-45faf5b6-f486-4a79-b930-d55a487cb031 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: a2a5c24f-2c38-49f9-b39c-ee1ee740e884] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:16.846206 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-45faf5b6-f486-4a79-b930-d55a487cb031 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:16.846698 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-45faf5b6-f486-4a79-b930-d55a487cb031 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:16.847138 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-45faf5b6-f486-4a79-b930-d55a487cb031 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:16.847842 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-45faf5b6-f486-4a79-b930-d55a487cb031 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:16.848300 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-45faf5b6-f486-4a79-b930-d55a487cb031 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:16.848754 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-45faf5b6-f486-4a79-b930-d55a487cb031 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:16.979545 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-45faf5b6-f486-4a79-b930-d55a487cb031 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:16.987307 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-45faf5b6-f486-4a79-b930-d55a487cb031 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884" status: 200 len: 1264 microversion: 2.1 time: 0.152678 Aug 24 08:03:16.987775 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 413/822] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:16 2022] GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:17.830348 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-cc74ab4e-5027-4e5a-aa8c-2ceeba5d690e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:17.830962 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-cc74ab4e-5027-4e5a-aa8c-2ceeba5d690e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:17.838925 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cc74ab4e-5027-4e5a-aa8c-2ceeba5d690e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:17.839417 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cc74ab4e-5027-4e5a-aa8c-2ceeba5d690e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:17.839854 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cc74ab4e-5027-4e5a-aa8c-2ceeba5d690e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:17.840561 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cc74ab4e-5027-4e5a-aa8c-2ceeba5d690e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:17.841049 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cc74ab4e-5027-4e5a-aa8c-2ceeba5d690e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:17.841478 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-cc74ab4e-5027-4e5a-aa8c-2ceeba5d690e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:17.902376 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-cc74ab4e-5027-4e5a-aa8c-2ceeba5d690e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:17.913021 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-cc74ab4e-5027-4e5a-aa8c-2ceeba5d690e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1241 microversion: 2.1 time: 0.086243 Aug 24 08:03:17.914189 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 410/823] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:17 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:18.008460 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-55c68a90-d2a7-43ad-81de-f3bc0f43a4f1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:18.009106 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-55c68a90-d2a7-43ad-81de-f3bc0f43a4f1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: a2a5c24f-2c38-49f9-b39c-ee1ee740e884] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:18.015778 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-55c68a90-d2a7-43ad-81de-f3bc0f43a4f1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:18.019625 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-55c68a90-d2a7-43ad-81de-f3bc0f43a4f1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:18.019625 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-55c68a90-d2a7-43ad-81de-f3bc0f43a4f1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:18.019625 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-55c68a90-d2a7-43ad-81de-f3bc0f43a4f1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:18.019625 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-55c68a90-d2a7-43ad-81de-f3bc0f43a4f1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:18.019976 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-55c68a90-d2a7-43ad-81de-f3bc0f43a4f1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:18.147891 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-55c68a90-d2a7-43ad-81de-f3bc0f43a4f1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:18.155761 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-55c68a90-d2a7-43ad-81de-f3bc0f43a4f1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884" status: 200 len: 1264 microversion: 2.1 time: 0.151872 Aug 24 08:03:18.156313 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 414/824] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:18 2022] GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:18.933760 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-84b997c4-4d8c-428f-b0dd-d9f4f307a5de tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:18.934354 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-84b997c4-4d8c-428f-b0dd-d9f4f307a5de tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:18.941411 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-84b997c4-4d8c-428f-b0dd-d9f4f307a5de tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:18.942772 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-84b997c4-4d8c-428f-b0dd-d9f4f307a5de tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:18.943452 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-84b997c4-4d8c-428f-b0dd-d9f4f307a5de tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:18.945273 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-84b997c4-4d8c-428f-b0dd-d9f4f307a5de tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:18.947069 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-84b997c4-4d8c-428f-b0dd-d9f4f307a5de tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:18.948082 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-84b997c4-4d8c-428f-b0dd-d9f4f307a5de tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:19.032382 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-84b997c4-4d8c-428f-b0dd-d9f4f307a5de tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:19.041265 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-84b997c4-4d8c-428f-b0dd-d9f4f307a5de tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1297 microversion: 2.1 time: 0.111148 Aug 24 08:03:19.041835 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 411/825] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:18 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1297 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:19.176212 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-6420b60a-bc00-48ee-8fdf-93431dc76609 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:19.176840 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-6420b60a-bc00-48ee-8fdf-93431dc76609 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: a2a5c24f-2c38-49f9-b39c-ee1ee740e884] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:19.183487 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6420b60a-bc00-48ee-8fdf-93431dc76609 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:19.183972 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6420b60a-bc00-48ee-8fdf-93431dc76609 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:19.184405 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6420b60a-bc00-48ee-8fdf-93431dc76609 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:19.185154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6420b60a-bc00-48ee-8fdf-93431dc76609 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:19.185609 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6420b60a-bc00-48ee-8fdf-93431dc76609 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:19.186032 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6420b60a-bc00-48ee-8fdf-93431dc76609 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:19.422028 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-6420b60a-bc00-48ee-8fdf-93431dc76609 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:19.430918 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-6420b60a-bc00-48ee-8fdf-93431dc76609 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884" status: 200 len: 1264 microversion: 2.1 time: 0.258526 Aug 24 08:03:19.431486 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 415/826] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:19 2022] GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884 => generated 1264 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:20.061766 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-22c325d1-d770-45aa-a248-99b49f47953c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:20.062493 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-22c325d1-d770-45aa-a248-99b49f47953c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:20.069510 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-22c325d1-d770-45aa-a248-99b49f47953c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:20.069999 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-22c325d1-d770-45aa-a248-99b49f47953c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:20.070436 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-22c325d1-d770-45aa-a248-99b49f47953c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:20.071285 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-22c325d1-d770-45aa-a248-99b49f47953c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:20.071739 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-22c325d1-d770-45aa-a248-99b49f47953c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:20.072161 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-22c325d1-d770-45aa-a248-99b49f47953c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:20.205597 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-22c325d1-d770-45aa-a248-99b49f47953c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:20.213936 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-22c325d1-d770-45aa-a248-99b49f47953c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1362 microversion: 2.1 time: 0.156212 Aug 24 08:03:20.214500 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 412/827] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:20 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:20.451469 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-fb89dba3-5c7c-48d0-8d3b-67b32bc0d898 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:20.452082 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-fb89dba3-5c7c-48d0-8d3b-67b32bc0d898 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: a2a5c24f-2c38-49f9-b39c-ee1ee740e884] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:20.458657 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fb89dba3-5c7c-48d0-8d3b-67b32bc0d898 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:20.459064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fb89dba3-5c7c-48d0-8d3b-67b32bc0d898 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:20.459503 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fb89dba3-5c7c-48d0-8d3b-67b32bc0d898 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:20.460826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fb89dba3-5c7c-48d0-8d3b-67b32bc0d898 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:20.461298 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fb89dba3-5c7c-48d0-8d3b-67b32bc0d898 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:20.461717 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fb89dba3-5c7c-48d0-8d3b-67b32bc0d898 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:20.613301 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-fb89dba3-5c7c-48d0-8d3b-67b32bc0d898 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:20.622046 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-fb89dba3-5c7c-48d0-8d3b-67b32bc0d898 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884" status: 200 len: 1264 microversion: 2.1 time: 0.174558 Aug 24 08:03:20.622609 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 416/828] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:20 2022] GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:20.646121 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-8b799a9e-8138-4323-a1ee-c8bb1baa9cae req-f1dfceec-c26b-4255-ad92-69180ca04625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "840d9152-ac7c-4205-b159-d6151037a3be", "tag": "43d8f622-820b-42da-a0f0-3f89f04d79a0"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:03:20.656579 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-8b799a9e-8138-4323-a1ee-c8bb1baa9cae req-f1dfceec-c26b-4255-ad92-69180ca04625 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:20.657127 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-8b799a9e-8138-4323-a1ee-c8bb1baa9cae req-f1dfceec-c26b-4255-ad92-69180ca04625 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:20.657553 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-8b799a9e-8138-4323-a1ee-c8bb1baa9cae req-f1dfceec-c26b-4255-ad92-69180ca04625 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:20.669845 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-8b799a9e-8138-4323-a1ee-c8bb1baa9cae req-f1dfceec-c26b-4255-ad92-69180ca04625 service nova] Creating event network-changed:43d8f622-820b-42da-a0f0-3f89f04d79a0 for instance 840d9152-ac7c-4205-b159-d6151037a3be on hv-cinder-85427 Aug 24 08:03:20.674916 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-8b799a9e-8138-4323-a1ee-c8bb1baa9cae req-f1dfceec-c26b-4255-ad92-69180ca04625 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032679 Aug 24 08:03:20.675495 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 413/829] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:03:21.059636 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-5b7bc1e8-a0b8-4487-bb44-38ebf86b1b6e req-22016c7f-d1f7-4475-adaa-b12439352a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a5c24f-2c38-49f9-b39c-ee1ee740e884", "name": "network-vif-plugged", "status": "completed", "tag": "68223bf4-fae5-411c-b20b-32c5a0298520"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:03:21.069798 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-5b7bc1e8-a0b8-4487-bb44-38ebf86b1b6e req-22016c7f-d1f7-4475-adaa-b12439352a61 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:21.072753 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-5b7bc1e8-a0b8-4487-bb44-38ebf86b1b6e req-22016c7f-d1f7-4475-adaa-b12439352a61 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:21.072753 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-5b7bc1e8-a0b8-4487-bb44-38ebf86b1b6e req-22016c7f-d1f7-4475-adaa-b12439352a61 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:21.082266 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-5b7bc1e8-a0b8-4487-bb44-38ebf86b1b6e req-22016c7f-d1f7-4475-adaa-b12439352a61 service nova] Creating event network-vif-plugged:68223bf4-fae5-411c-b20b-32c5a0298520 for instance a2a5c24f-2c38-49f9-b39c-ee1ee740e884 on hv-cinder-85427 Aug 24 08:03:21.087396 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-5b7bc1e8-a0b8-4487-bb44-38ebf86b1b6e req-22016c7f-d1f7-4475-adaa-b12439352a61 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032165 Aug 24 08:03:21.087983 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 417/830] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:03:21.235896 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-1b87609b-5f18-4560-9f5e-63b89ffddda4 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:21.236632 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-1b87609b-5f18-4560-9f5e-63b89ffddda4 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:21.243983 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1b87609b-5f18-4560-9f5e-63b89ffddda4 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:21.244476 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1b87609b-5f18-4560-9f5e-63b89ffddda4 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:21.244944 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1b87609b-5f18-4560-9f5e-63b89ffddda4 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:21.245737 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1b87609b-5f18-4560-9f5e-63b89ffddda4 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:21.246197 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1b87609b-5f18-4560-9f5e-63b89ffddda4 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:21.246632 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1b87609b-5f18-4560-9f5e-63b89ffddda4 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:21.389042 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-1b87609b-5f18-4560-9f5e-63b89ffddda4 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:21.396826 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-1b87609b-5f18-4560-9f5e-63b89ffddda4 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1362 microversion: 2.1 time: 0.165054 Aug 24 08:03:21.398022 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 414/831] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:21 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:21.643900 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-00daa2a1-59a1-4941-955a-e194661d0343 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:21.644909 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-00daa2a1-59a1-4941-955a-e194661d0343 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: a2a5c24f-2c38-49f9-b39c-ee1ee740e884] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:21.654465 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-00daa2a1-59a1-4941-955a-e194661d0343 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:21.655538 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-00daa2a1-59a1-4941-955a-e194661d0343 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:21.656324 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-00daa2a1-59a1-4941-955a-e194661d0343 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:21.657640 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-00daa2a1-59a1-4941-955a-e194661d0343 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:21.658500 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-00daa2a1-59a1-4941-955a-e194661d0343 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:21.659314 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-00daa2a1-59a1-4941-955a-e194661d0343 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:21.803316 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-00daa2a1-59a1-4941-955a-e194661d0343 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:21.811035 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-00daa2a1-59a1-4941-955a-e194661d0343 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884" status: 200 len: 1264 microversion: 2.1 time: 0.171980 Aug 24 08:03:21.811598 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 418/832] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:21 2022] GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:22.418220 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-3c2684c7-da57-4cea-9d5d-572a8d2c2b10 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:22.418820 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-3c2684c7-da57-4cea-9d5d-572a8d2c2b10 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:22.425308 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3c2684c7-da57-4cea-9d5d-572a8d2c2b10 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:22.425794 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3c2684c7-da57-4cea-9d5d-572a8d2c2b10 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:22.426233 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3c2684c7-da57-4cea-9d5d-572a8d2c2b10 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:22.426927 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3c2684c7-da57-4cea-9d5d-572a8d2c2b10 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:22.427384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3c2684c7-da57-4cea-9d5d-572a8d2c2b10 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:22.427812 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3c2684c7-da57-4cea-9d5d-572a8d2c2b10 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:22.430621 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:22.556411 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-3c2684c7-da57-4cea-9d5d-572a8d2c2b10 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:22.564080 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-3c2684c7-da57-4cea-9d5d-572a8d2c2b10 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1362 microversion: 2.1 time: 0.149771 Aug 24 08:03:22.564713 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 415/833] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:22 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:22.831378 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e55443dc-3058-4a0e-b734-e0fc2dcb9c8b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:22.831997 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-e55443dc-3058-4a0e-b734-e0fc2dcb9c8b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: a2a5c24f-2c38-49f9-b39c-ee1ee740e884] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:22.834418 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:22.839178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e55443dc-3058-4a0e-b734-e0fc2dcb9c8b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:22.839663 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e55443dc-3058-4a0e-b734-e0fc2dcb9c8b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:22.840104 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e55443dc-3058-4a0e-b734-e0fc2dcb9c8b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:22.840839 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e55443dc-3058-4a0e-b734-e0fc2dcb9c8b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:22.841324 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e55443dc-3058-4a0e-b734-e0fc2dcb9c8b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:22.841753 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e55443dc-3058-4a0e-b734-e0fc2dcb9c8b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:22.844539 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=95 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:22.974983 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e55443dc-3058-4a0e-b734-e0fc2dcb9c8b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:22.982887 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-e55443dc-3058-4a0e-b734-e0fc2dcb9c8b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884" status: 200 len: 1264 microversion: 2.1 time: 0.155433 Aug 24 08:03:22.983456 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 419/834] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:22 2022] GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:23.586158 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-0656a711-a603-4360-8291-08a0519b0620 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:23.586770 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-0656a711-a603-4360-8291-08a0519b0620 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:23.589153 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:23.594036 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0656a711-a603-4360-8291-08a0519b0620 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:23.594522 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0656a711-a603-4360-8291-08a0519b0620 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:23.594961 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0656a711-a603-4360-8291-08a0519b0620 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:23.595655 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0656a711-a603-4360-8291-08a0519b0620 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:23.596111 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0656a711-a603-4360-8291-08a0519b0620 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:23.596535 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0656a711-a603-4360-8291-08a0519b0620 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:23.736398 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-0656a711-a603-4360-8291-08a0519b0620 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:23.744192 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-0656a711-a603-4360-8291-08a0519b0620 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1362 microversion: 2.1 time: 0.162585 Aug 24 08:03:23.744780 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 416/835] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:23 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:24.003503 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-5d12b864-f4b5-4721-b1b6-6674ef61b3d5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:24.004045 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-5d12b864-f4b5-4721-b1b6-6674ef61b3d5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: a2a5c24f-2c38-49f9-b39c-ee1ee740e884] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:24.011211 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5d12b864-f4b5-4721-b1b6-6674ef61b3d5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:24.011693 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5d12b864-f4b5-4721-b1b6-6674ef61b3d5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:24.012136 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5d12b864-f4b5-4721-b1b6-6674ef61b3d5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:24.012875 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5d12b864-f4b5-4721-b1b6-6674ef61b3d5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:24.013334 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5d12b864-f4b5-4721-b1b6-6674ef61b3d5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:24.013764 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5d12b864-f4b5-4721-b1b6-6674ef61b3d5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:24.140560 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-5d12b864-f4b5-4721-b1b6-6674ef61b3d5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:24.148966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-5d12b864-f4b5-4721-b1b6-6674ef61b3d5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884" status: 200 len: 1450 microversion: 2.1 time: 0.149407 Aug 24 08:03:24.149556 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 420/836] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:23 2022] GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:24.168800 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-a7367ccc-3d3c-4459-b5e7-77d35d571010 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:24.169422 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-a7367ccc-3d3c-4459-b5e7-77d35d571010 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: a2a5c24f-2c38-49f9-b39c-ee1ee740e884] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:24.175275 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a7367ccc-3d3c-4459-b5e7-77d35d571010 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:24.175753 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a7367ccc-3d3c-4459-b5e7-77d35d571010 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:24.176187 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a7367ccc-3d3c-4459-b5e7-77d35d571010 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:24.176903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a7367ccc-3d3c-4459-b5e7-77d35d571010 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:24.177354 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a7367ccc-3d3c-4459-b5e7-77d35d571010 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:24.177772 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a7367ccc-3d3c-4459-b5e7-77d35d571010 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:24.310866 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-a7367ccc-3d3c-4459-b5e7-77d35d571010 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:24.318652 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-a7367ccc-3d3c-4459-b5e7-77d35d571010 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884" status: 200 len: 1450 microversion: 2.1 time: 0.153650 Aug 24 08:03:24.319789 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 417/837] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:24 2022] GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:24.765493 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-52ce6ac1-c11c-4f96-b4b0-fe3ba660dfbe tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:24.766114 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-52ce6ac1-c11c-4f96-b4b0-fe3ba660dfbe tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:24.772249 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-52ce6ac1-c11c-4f96-b4b0-fe3ba660dfbe tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:24.772772 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-52ce6ac1-c11c-4f96-b4b0-fe3ba660dfbe tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:24.773216 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-52ce6ac1-c11c-4f96-b4b0-fe3ba660dfbe tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:24.773931 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-52ce6ac1-c11c-4f96-b4b0-fe3ba660dfbe tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:24.774387 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-52ce6ac1-c11c-4f96-b4b0-fe3ba660dfbe tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:24.774823 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-52ce6ac1-c11c-4f96-b4b0-fe3ba660dfbe tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:25.093941 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-c971ffff-4f62-4431-bd27-ba00e4720cb4 req-a88a4cf7-0900-426e-abfc-f86b1e0d8ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "840d9152-ac7c-4205-b159-d6151037a3be", "name": "network-vif-plugged", "status": "completed", "tag": "43d8f622-820b-42da-a0f0-3f89f04d79a0"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:03:25.105083 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-c971ffff-4f62-4431-bd27-ba00e4720cb4 req-a88a4cf7-0900-426e-abfc-f86b1e0d8ef8 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:25.105570 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-c971ffff-4f62-4431-bd27-ba00e4720cb4 req-a88a4cf7-0900-426e-abfc-f86b1e0d8ef8 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:25.106095 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-c971ffff-4f62-4431-bd27-ba00e4720cb4 req-a88a4cf7-0900-426e-abfc-f86b1e0d8ef8 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:25.120238 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-c971ffff-4f62-4431-bd27-ba00e4720cb4 req-a88a4cf7-0900-426e-abfc-f86b1e0d8ef8 service nova] Creating event network-vif-plugged:43d8f622-820b-42da-a0f0-3f89f04d79a0 for instance 840d9152-ac7c-4205-b159-d6151037a3be on hv-cinder-85427 Aug 24 08:03:25.125605 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-c971ffff-4f62-4431-bd27-ba00e4720cb4 req-a88a4cf7-0900-426e-abfc-f86b1e0d8ef8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035452 Aug 24 08:03:25.126215 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 418/838] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:03:25.231583 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-52ce6ac1-c11c-4f96-b4b0-fe3ba660dfbe tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:25.240560 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-52ce6ac1-c11c-4f96-b4b0-fe3ba660dfbe tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1362 microversion: 2.1 time: 0.479281 Aug 24 08:03:25.241482 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 421/839] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:24 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1362 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:26.262835 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-db3b55b5-5557-4304-a2d9-4a3f46a95c1f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:26.263639 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-db3b55b5-5557-4304-a2d9-4a3f46a95c1f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:26.269956 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-db3b55b5-5557-4304-a2d9-4a3f46a95c1f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:26.270438 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-db3b55b5-5557-4304-a2d9-4a3f46a95c1f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:26.270941 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-db3b55b5-5557-4304-a2d9-4a3f46a95c1f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:26.271764 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-db3b55b5-5557-4304-a2d9-4a3f46a95c1f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:26.272095 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-db3b55b5-5557-4304-a2d9-4a3f46a95c1f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:26.272518 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-db3b55b5-5557-4304-a2d9-4a3f46a95c1f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:26.409835 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-db3b55b5-5557-4304-a2d9-4a3f46a95c1f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:26.418684 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-db3b55b5-5557-4304-a2d9-4a3f46a95c1f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1362 microversion: 2.1 time: 0.160843 Aug 24 08:03:26.419259 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 419/840] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:26 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:26.698268 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-e64fe17e-630f-4a43-8e90-0ab16e97b144 req-3b7bb7b5-4508-4693-95a2-991642d2df2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2a5c24f-2c38-49f9-b39c-ee1ee740e884", "tag": "68223bf4-fae5-411c-b20b-32c5a0298520"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:03:26.703477 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=2 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:26.704140 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=6 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:26.709332 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-e64fe17e-630f-4a43-8e90-0ab16e97b144 req-3b7bb7b5-4508-4693-95a2-991642d2df2f service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:26.710467 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-e64fe17e-630f-4a43-8e90-0ab16e97b144 req-3b7bb7b5-4508-4693-95a2-991642d2df2f service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:26.710906 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-e64fe17e-630f-4a43-8e90-0ab16e97b144 req-3b7bb7b5-4508-4693-95a2-991642d2df2f service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:26.722216 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-e64fe17e-630f-4a43-8e90-0ab16e97b144 req-3b7bb7b5-4508-4693-95a2-991642d2df2f service nova] Creating event network-changed:68223bf4-fae5-411c-b20b-32c5a0298520 for instance a2a5c24f-2c38-49f9-b39c-ee1ee740e884 on hv-cinder-85427 Aug 24 08:03:26.727784 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-e64fe17e-630f-4a43-8e90-0ab16e97b144 req-3b7bb7b5-4508-4693-95a2-991642d2df2f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033193 Aug 24 08:03:26.728362 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 422/841] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:03:27.439568 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-41b16d5b-6974-4c47-98e1-262102c2ce2d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:27.441127 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-41b16d5b-6974-4c47-98e1-262102c2ce2d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:27.443566 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=14 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:27.450251 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-41b16d5b-6974-4c47-98e1-262102c2ce2d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:27.451803 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-41b16d5b-6974-4c47-98e1-262102c2ce2d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:27.451803 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-41b16d5b-6974-4c47-98e1-262102c2ce2d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:27.452071 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-41b16d5b-6974-4c47-98e1-262102c2ce2d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:27.452369 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-41b16d5b-6974-4c47-98e1-262102c2ce2d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:27.452832 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-41b16d5b-6974-4c47-98e1-262102c2ce2d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:27.588517 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-41b16d5b-6974-4c47-98e1-262102c2ce2d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:27.596662 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-41b16d5b-6974-4c47-98e1-262102c2ce2d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1546 microversion: 2.1 time: 0.161099 Aug 24 08:03:27.597367 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 420/842] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:27 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1546 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:27.618402 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-6d9d0231-565a-4e02-849f-9144ef3d6c0e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:27.618999 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-6d9d0231-565a-4e02-849f-9144ef3d6c0e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:27.625651 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6d9d0231-565a-4e02-849f-9144ef3d6c0e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:27.626143 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6d9d0231-565a-4e02-849f-9144ef3d6c0e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:27.626580 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6d9d0231-565a-4e02-849f-9144ef3d6c0e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:27.627287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6d9d0231-565a-4e02-849f-9144ef3d6c0e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:27.627741 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6d9d0231-565a-4e02-849f-9144ef3d6c0e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:27.628170 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6d9d0231-565a-4e02-849f-9144ef3d6c0e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:27.709178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-6d9d0231-565a-4e02-849f-9144ef3d6c0e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095328 Aug 24 08:03:27.710635 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 423/843] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 24 08:03:27 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:03:28.742260 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-6d3fd3bc-1285-4883-83f7-77dbc47570f7 req-00bc6ee7-d8ed-4e8d-bfea-0aae4b46c68a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "840d9152-ac7c-4205-b159-d6151037a3be", "tag": "43d8f622-820b-42da-a0f0-3f89f04d79a0"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:03:28.753430 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-6d3fd3bc-1285-4883-83f7-77dbc47570f7 req-00bc6ee7-d8ed-4e8d-bfea-0aae4b46c68a service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:28.753943 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-6d3fd3bc-1285-4883-83f7-77dbc47570f7 req-00bc6ee7-d8ed-4e8d-bfea-0aae4b46c68a service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:28.754445 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-6d3fd3bc-1285-4883-83f7-77dbc47570f7 req-00bc6ee7-d8ed-4e8d-bfea-0aae4b46c68a service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:28.765938 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-6d3fd3bc-1285-4883-83f7-77dbc47570f7 req-00bc6ee7-d8ed-4e8d-bfea-0aae4b46c68a service nova] Creating event network-changed:43d8f622-820b-42da-a0f0-3f89f04d79a0 for instance 840d9152-ac7c-4205-b159-d6151037a3be on hv-cinder-85427 Aug 24 08:03:28.770978 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-6d3fd3bc-1285-4883-83f7-77dbc47570f7 req-00bc6ee7-d8ed-4e8d-bfea-0aae4b46c68a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032638 Aug 24 08:03:28.771652 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 421/844] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:03:55.375985 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=11 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:55.377339 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=9 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:55.378249 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=33 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:55.378906 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=23 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:55.382937 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-63e32727-d0db-492a-af6a-5f3049f6e25c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:55.383438 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-63e32727-d0db-492a-af6a-5f3049f6e25c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:55.388326 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-4b4eb47d-b503-4359-9382-a67514541e3c req-032aa841-3d06-4732-a31a-43499a25aca1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ce799f4-91d9-4521-af5d-63757a11823c", "tag": "b6e8c168-af88-483f-9e17-53d9c3c9d376"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:03:55.394841 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-63e32727-d0db-492a-af6a-5f3049f6e25c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:55.395423 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-63e32727-d0db-492a-af6a-5f3049f6e25c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:55.396290 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-63e32727-d0db-492a-af6a-5f3049f6e25c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:55.396645 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-63e32727-d0db-492a-af6a-5f3049f6e25c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:55.397126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-63e32727-d0db-492a-af6a-5f3049f6e25c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:55.401570 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-63e32727-d0db-492a-af6a-5f3049f6e25c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:55.401702 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-4b4eb47d-b503-4359-9382-a67514541e3c req-032aa841-3d06-4732-a31a-43499a25aca1 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:55.401810 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-4b4eb47d-b503-4359-9382-a67514541e3c req-032aa841-3d06-4732-a31a-43499a25aca1 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:55.402243 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-4b4eb47d-b503-4359-9382-a67514541e3c req-032aa841-3d06-4732-a31a-43499a25aca1 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:55.415520 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-4b4eb47d-b503-4359-9382-a67514541e3c req-032aa841-3d06-4732-a31a-43499a25aca1 service nova] Creating event network-changed:b6e8c168-af88-483f-9e17-53d9c3c9d376 for instance 3ce799f4-91d9-4521-af5d-63757a11823c on hv-cinder-85427 Aug 24 08:03:55.420986 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-4b4eb47d-b503-4359-9382-a67514541e3c req-032aa841-3d06-4732-a31a-43499a25aca1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046300 Aug 24 08:03:55.421806 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 422/845] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:03:55.431433 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-63e32727-d0db-492a-af6a-5f3049f6e25c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Going to try to terminate instance {{(pid=127589) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:03:55.710220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-63e32727-d0db-492a-af6a-5f3049f6e25c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 204 len: 0 microversion: 2.1 time: 0.337857 Aug 24 08:03:55.714444 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 424/846] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 24 08:03:55 2022] DELETE /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:03:55.720934 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-8c8c1800-81e5-4535-ae39-ddbb13a6e666 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:55.721628 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-8c8c1800-81e5-4535-ae39-ddbb13a6e666 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:55.729091 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8c8c1800-81e5-4535-ae39-ddbb13a6e666 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:55.729643 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8c8c1800-81e5-4535-ae39-ddbb13a6e666 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:55.730273 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8c8c1800-81e5-4535-ae39-ddbb13a6e666 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:55.730980 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8c8c1800-81e5-4535-ae39-ddbb13a6e666 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:55.731425 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8c8c1800-81e5-4535-ae39-ddbb13a6e666 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:55.731913 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8c8c1800-81e5-4535-ae39-ddbb13a6e666 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:55.869379 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-8c8c1800-81e5-4535-ae39-ddbb13a6e666 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:55.877905 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-8c8c1800-81e5-4535-ae39-ddbb13a6e666 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1569 microversion: 2.1 time: 0.161918 Aug 24 08:03:55.878480 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 423/847] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:55 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:56.900451 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-3e8908d1-18b8-4c37-8c56-cd0b1bd17309 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:56.901751 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-3e8908d1-18b8-4c37-8c56-cd0b1bd17309 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:56.908675 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3e8908d1-18b8-4c37-8c56-cd0b1bd17309 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:56.911975 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3e8908d1-18b8-4c37-8c56-cd0b1bd17309 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:56.911975 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3e8908d1-18b8-4c37-8c56-cd0b1bd17309 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:56.911975 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3e8908d1-18b8-4c37-8c56-cd0b1bd17309 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:56.911975 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3e8908d1-18b8-4c37-8c56-cd0b1bd17309 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:56.912321 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3e8908d1-18b8-4c37-8c56-cd0b1bd17309 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:57.052256 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-3e8908d1-18b8-4c37-8c56-cd0b1bd17309 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:57.060826 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-3e8908d1-18b8-4c37-8c56-cd0b1bd17309 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1569 microversion: 2.1 time: 0.164974 Aug 24 08:03:57.072782 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 425/848] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:56 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:57.936153 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-dd4e77c8-f4af-4705-b8c8-9d9aff94c8e1 req-60916c9c-cdb6-4782-8392-060ce03ca3a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce799f4-91d9-4521-af5d-63757a11823c", "name": "network-vif-deleted", "tag": "b6e8c168-af88-483f-9e17-53d9c3c9d376"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:03:57.946871 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-dd4e77c8-f4af-4705-b8c8-9d9aff94c8e1 req-60916c9c-cdb6-4782-8392-060ce03ca3a6 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:57.947269 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-dd4e77c8-f4af-4705-b8c8-9d9aff94c8e1 req-60916c9c-cdb6-4782-8392-060ce03ca3a6 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:57.947730 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-dd4e77c8-f4af-4705-b8c8-9d9aff94c8e1 req-60916c9c-cdb6-4782-8392-060ce03ca3a6 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:57.959130 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-dd4e77c8-f4af-4705-b8c8-9d9aff94c8e1 req-60916c9c-cdb6-4782-8392-060ce03ca3a6 service nova] Creating event network-vif-deleted:b6e8c168-af88-483f-9e17-53d9c3c9d376 for instance 3ce799f4-91d9-4521-af5d-63757a11823c on hv-cinder-85427 Aug 24 08:03:57.963982 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-dd4e77c8-f4af-4705-b8c8-9d9aff94c8e1 req-60916c9c-cdb6-4782-8392-060ce03ca3a6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031444 Aug 24 08:03:57.964553 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 424/849] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:03:58.083387 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-07913407-68f4-4bac-bb97-9e6bdba7811a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:58.084028 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-07913407-68f4-4bac-bb97-9e6bdba7811a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:58.090619 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-07913407-68f4-4bac-bb97-9e6bdba7811a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:58.091117 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-07913407-68f4-4bac-bb97-9e6bdba7811a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:58.091560 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-07913407-68f4-4bac-bb97-9e6bdba7811a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:58.092297 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-07913407-68f4-4bac-bb97-9e6bdba7811a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:58.092780 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-07913407-68f4-4bac-bb97-9e6bdba7811a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:58.093214 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-07913407-68f4-4bac-bb97-9e6bdba7811a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:58.155957 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-07913407-68f4-4bac-bb97-9e6bdba7811a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:58.163672 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-07913407-68f4-4bac-bb97-9e6bdba7811a tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1220 microversion: 2.1 time: 0.084250 Aug 24 08:03:58.164225 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 426/850] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:58 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:03:59.185813 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-0cae56f4-3886-499f-b2df-3d0f6cdf02f7 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:03:59.186504 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-0cae56f4-3886-499f-b2df-3d0f6cdf02f7 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:03:59.193406 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0cae56f4-3886-499f-b2df-3d0f6cdf02f7 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:59.193941 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0cae56f4-3886-499f-b2df-3d0f6cdf02f7 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:59.194421 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0cae56f4-3886-499f-b2df-3d0f6cdf02f7 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:59.195119 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0cae56f4-3886-499f-b2df-3d0f6cdf02f7 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:59.195614 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0cae56f4-3886-499f-b2df-3d0f6cdf02f7 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:59.196043 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0cae56f4-3886-499f-b2df-3d0f6cdf02f7 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:59.233748 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0cae56f4-3886-499f-b2df-3d0f6cdf02f7 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:03:59.234149 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0cae56f4-3886-499f-b2df-3d0f6cdf02f7 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:03:59.234590 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0cae56f4-3886-499f-b2df-3d0f6cdf02f7 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:03:59.235041 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.objects.instance [None req-0cae56f4-3886-499f-b2df-3d0f6cdf02f7 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lazy-loading 'fault' on Instance uuid 3ce799f4-91d9-4521-af5d-63757a11823c {{(pid=127590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:03:59.280671 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-0cae56f4-3886-499f-b2df-3d0f6cdf02f7 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae325c8314c47a384a83509e3c281a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576781ceab42470e9fd28a32ccb29e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:03:59.288644 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-0cae56f4-3886-499f-b2df-3d0f6cdf02f7 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 200 len: 1225 microversion: 2.1 time: 0.107723 Aug 24 08:03:59.289232 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 425/851] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:03:59 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:00.311281 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-62467c6c-cc44-48d4-9d17-52ee0d98139c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:00.311894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-62467c6c-cc44-48d4-9d17-52ee0d98139c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] [instance: 3ce799f4-91d9-4521-af5d-63757a11823c] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:00.318408 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-62467c6c-cc44-48d4-9d17-52ee0d98139c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:00.318893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-62467c6c-cc44-48d4-9d17-52ee0d98139c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:00.319335 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-62467c6c-cc44-48d4-9d17-52ee0d98139c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:00.320030 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-62467c6c-cc44-48d4-9d17-52ee0d98139c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:00.320488 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-62467c6c-cc44-48d4-9d17-52ee0d98139c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:00.320945 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-62467c6c-cc44-48d4-9d17-52ee0d98139c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:00.334475 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-62467c6c-cc44-48d4-9d17-52ee0d98139c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] HTTP exception thrown: Instance 3ce799f4-91d9-4521-af5d-63757a11823c could not be found. Aug 24 08:04:00.336112 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-62467c6c-cc44-48d4-9d17-52ee0d98139c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Request method failure captured: Aug 24 08:04:00.336112 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c HTTP/1.1 Aug 24 08:04:00.336112 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 08:04:00.336112 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 08:04:00.336112 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 08:04:00.336112 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 08:04:00.336112 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 08:04:00.336112 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 08:04:00.336112 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 08:04:00.336112 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 08:04:00.336112 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdo8ROz_el-5PMxEP8-asEjYkL_W6qHIBROWoNnYPS7r2DX4g3VtjgxF0Vo9CX-AZsCHim0Utt3NckMxdEufIOWxZFHBuLLCd2cfE-9WxbXP2GzxKS6Fbk3hp9uE0-piaydS80ZbZE8Ven8wFYHLmjvhZ_TIy-hUMKuFLkOx0Y7rzUM Aug 24 08:04:00.336112 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 08:04:00.336112 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 08:04:00.336112 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 08:04:00.336112 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 08:04:00.336112 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 08:04:00.336112 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 08:04:00.336112 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: 576781ceab42470e9fd28a32ccb29e7f Aug 24 08:04:00.336112 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-TestShelveInstance-763429057 Aug 24 08:04:00.336112 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 08:04:00.336112 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 08:04:00.337820 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_576781ceab42470e9fd28a32ccb29e7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/576781ceab42470e9fd28a32ccb29e7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/576781ceab42470e9fd28a32ccb29e7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/576781ceab42470e9fd28a32ccb29e7f"}]}] Aug 24 08:04:00.337820 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-TestShelveInstance-763429057 Aug 24 08:04:00.337820 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: 576781ceab42470e9fd28a32ccb29e7f Aug 24 08:04:00.337820 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-TestShelveInstance-763429057 Aug 24 08:04:00.337820 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-TestShelveInstance-763429057-project Aug 24 08:04:00.337820 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 08:04:00.337820 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 08:04:00.337820 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 0ae325c8314c47a384a83509e3c281a0 Aug 24 08:04:00.337820 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-TestShelveInstance-763429057-project Aug 24 08:04:00.337820 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 08:04:00.337820 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Instance 3ce799f4-91d9-4521-af5d-63757a11823c could not be found. Aug 24 08:04:00.337820 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': '3ce799f4-91d9-4521-af5d-63757a11823c'} Aug 24 08:04:00.338894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:04:00.338894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:04:00.338894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:04:00.338894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:04:00.338894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:04:00.338894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:04:00.338894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:04:00.338894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:04:00.338894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:04:00.338894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:04:00.338894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ce799f4-91d9-4521-af5d-63757a11823c could not be found. Aug 24 08:04:00.338894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:04:00.338894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:04:00.338894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:04:00.338894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:04:00.338894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:04:00.338894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:04:00.338894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:04:00.338894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:04:00.338894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:04:00.340453 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:04:00.340453 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:04:00.340453 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:04:00.340453 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:04:00.340453 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:04:00.340453 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:04:00.340453 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:04:00.340453 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ce799f4-91d9-4521-af5d-63757a11823c could not be found. Aug 24 08:04:00.340453 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:04:00.340453 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:04:00.340453 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:04:00.340453 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:04:00.340453 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:04:00.340453 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:04:00.340453 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:04:00.340453 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:04:00.340453 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ce799f4-91d9-4521-af5d-63757a11823c could not be found. Aug 24 08:04:00.340453 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:04:00.342523 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-62467c6c-cc44-48d4-9d17-52ee0d98139c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Returning 404 to user: Instance 3ce799f4-91d9-4521-af5d-63757a11823c could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:04:00.342523 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-62467c6c-cc44-48d4-9d17-52ee0d98139c tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c" status: 404 len: 111 microversion: 2.1 time: 0.030750 Aug 24 08:04:00.342523 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 427/852] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:00 2022] GET /compute/v2.1/servers/3ce799f4-91d9-4521-af5d-63757a11823c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:04:00.559259 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-3648d3ad-e63f-40e6-9f0c-87d195b29f17 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] Calling method '.version_select at 0x7f3210afd280>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:00.625118 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-3648d3ad-e63f-40e6-9f0c-87d195b29f17 tempest-TestShelveInstance-763429057 tempest-TestShelveInstance-763429057-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1957195615" status: 202 len: 0 microversion: 2.1 time: 0.069609 Aug 24 08:04:00.625779 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 426/853] 10.222.0.72 () {58 vars in 1254 bytes} [Wed Aug 24 08:04:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1957195615 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:04:04.642988 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-c1f55344-1213-42fb-a500-a52ca7a71bf2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:04.643562 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-c1f55344-1213-42fb-a500-a52ca7a71bf2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:04.649981 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c1f55344-1213-42fb-a500-a52ca7a71bf2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:04.650468 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c1f55344-1213-42fb-a500-a52ca7a71bf2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:04.650898 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c1f55344-1213-42fb-a500-a52ca7a71bf2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:04.651588 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c1f55344-1213-42fb-a500-a52ca7a71bf2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:04.652034 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c1f55344-1213-42fb-a500-a52ca7a71bf2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:04.652452 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c1f55344-1213-42fb-a500-a52ca7a71bf2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:04.677473 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-c1f55344-1213-42fb-a500-a52ca7a71bf2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be/ips" status: 200 len: 143 microversion: 2.1 time: 0.038303 Aug 24 08:04:04.677953 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 428/854] 10.222.0.72 () {58 vars in 1248 bytes} [Wed Aug 24 08:04:04 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be/ips => generated 143 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:04:07.520058 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-77354302-758f-4b04-846e-956e45bb889b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b016474b-d0f3-40d0-8739-259cca52c79f"}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:04:07.522370 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-77354302-758f-4b04-846e-956e45bb889b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:07.529925 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-77354302-758f-4b04-846e-956e45bb889b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:07.534549 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-77354302-758f-4b04-846e-956e45bb889b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:07.534549 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-77354302-758f-4b04-846e-956e45bb889b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:07.534549 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-77354302-758f-4b04-846e-956e45bb889b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:07.534549 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-77354302-758f-4b04-846e-956e45bb889b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:07.534952 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-77354302-758f-4b04-846e-956e45bb889b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:08.422290 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-77354302-758f-4b04-846e-956e45bb889b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "POST /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.906838 Aug 24 08:04:08.422907 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 427/855] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 24 08:04:07 2022] POST /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be/os-volume_attachments => generated 194 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:04:15.945303 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-12e965e3-13ae-498f-b09c-b1be578c0b9c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:04:15.947976 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:15.948686 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:15.953958 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-12e965e3-13ae-498f-b09c-b1be578c0b9c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:15.954442 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-12e965e3-13ae-498f-b09c-b1be578c0b9c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:15.954881 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-12e965e3-13ae-498f-b09c-b1be578c0b9c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:16.020769 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-12e965e3-13ae-498f-b09c-b1be578c0b9c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Going to try to stop instance {{(pid=127589) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 08:04:16.198361 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-12e965e3-13ae-498f-b09c-b1be578c0b9c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "POST /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be/action" status: 202 len: 0 microversion: 2.1 time: 0.256651 Aug 24 08:04:16.198874 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 429/856] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 24 08:04:15 2022] POST /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:04:16.208174 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-b4c0d76c-6add-4758-82a8-6c450175e5c7 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:16.208923 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-b4c0d76c-6add-4758-82a8-6c450175e5c7 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:16.214963 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b4c0d76c-6add-4758-82a8-6c450175e5c7 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:16.215437 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b4c0d76c-6add-4758-82a8-6c450175e5c7 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:16.215867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b4c0d76c-6add-4758-82a8-6c450175e5c7 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:16.216645 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b4c0d76c-6add-4758-82a8-6c450175e5c7 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:16.217116 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b4c0d76c-6add-4758-82a8-6c450175e5c7 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:16.217533 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b4c0d76c-6add-4758-82a8-6c450175e5c7 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:16.350180 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-b4c0d76c-6add-4758-82a8-6c450175e5c7 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:16.358872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-b4c0d76c-6add-4758-82a8-6c450175e5c7 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1720 microversion: 2.1 time: 0.155437 Aug 24 08:04:16.359553 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 428/857] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:16 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:17.380775 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-1a8c2b00-e791-466b-901d-2f302dd14221 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:17.381480 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-1a8c2b00-e791-466b-901d-2f302dd14221 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:17.387648 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1a8c2b00-e791-466b-901d-2f302dd14221 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:17.388133 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1a8c2b00-e791-466b-901d-2f302dd14221 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:17.388576 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1a8c2b00-e791-466b-901d-2f302dd14221 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:17.389315 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1a8c2b00-e791-466b-901d-2f302dd14221 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:17.389775 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1a8c2b00-e791-466b-901d-2f302dd14221 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:17.390200 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1a8c2b00-e791-466b-901d-2f302dd14221 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:17.517437 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-1a8c2b00-e791-466b-901d-2f302dd14221 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:17.528213 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-1a8c2b00-e791-466b-901d-2f302dd14221 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1720 microversion: 2.1 time: 0.152121 Aug 24 08:04:17.529349 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 430/858] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:17 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:18.550400 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-fc6b6e22-66ed-449d-b041-49c1e1172799 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:18.551038 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-fc6b6e22-66ed-449d-b041-49c1e1172799 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:18.557607 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fc6b6e22-66ed-449d-b041-49c1e1172799 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:18.558088 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fc6b6e22-66ed-449d-b041-49c1e1172799 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:18.558524 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fc6b6e22-66ed-449d-b041-49c1e1172799 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:18.559209 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fc6b6e22-66ed-449d-b041-49c1e1172799 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:18.559662 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fc6b6e22-66ed-449d-b041-49c1e1172799 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:18.560678 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fc6b6e22-66ed-449d-b041-49c1e1172799 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:18.685827 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-fc6b6e22-66ed-449d-b041-49c1e1172799 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:18.693927 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-fc6b6e22-66ed-449d-b041-49c1e1172799 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1720 microversion: 2.1 time: 0.147412 Aug 24 08:04:18.694482 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 429/859] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:18 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:19.714960 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-136bd849-f991-4fa9-9c65-723f31f9c78c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:19.715569 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-136bd849-f991-4fa9-9c65-723f31f9c78c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:19.721724 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-136bd849-f991-4fa9-9c65-723f31f9c78c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:19.722206 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-136bd849-f991-4fa9-9c65-723f31f9c78c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:19.722640 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-136bd849-f991-4fa9-9c65-723f31f9c78c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:19.723360 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-136bd849-f991-4fa9-9c65-723f31f9c78c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:19.723817 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-136bd849-f991-4fa9-9c65-723f31f9c78c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:19.724241 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-136bd849-f991-4fa9-9c65-723f31f9c78c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:19.865617 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-136bd849-f991-4fa9-9c65-723f31f9c78c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:19.872748 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-136bd849-f991-4fa9-9c65-723f31f9c78c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1720 microversion: 2.1 time: 0.161736 Aug 24 08:04:19.873301 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 431/860] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:19 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:20.893210 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-ba19b5a9-3ddf-43e2-bb7b-c0605e4d9429 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:20.893825 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-ba19b5a9-3ddf-43e2-bb7b-c0605e4d9429 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:20.900349 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ba19b5a9-3ddf-43e2-bb7b-c0605e4d9429 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:20.900878 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ba19b5a9-3ddf-43e2-bb7b-c0605e4d9429 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:20.901322 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ba19b5a9-3ddf-43e2-bb7b-c0605e4d9429 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:20.902015 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ba19b5a9-3ddf-43e2-bb7b-c0605e4d9429 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:20.902474 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ba19b5a9-3ddf-43e2-bb7b-c0605e4d9429 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:20.902900 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ba19b5a9-3ddf-43e2-bb7b-c0605e4d9429 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:21.033545 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-ba19b5a9-3ddf-43e2-bb7b-c0605e4d9429 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:21.041746 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-ba19b5a9-3ddf-43e2-bb7b-c0605e4d9429 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1720 microversion: 2.1 time: 0.152417 Aug 24 08:04:21.042306 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 430/861] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:20 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:22.063585 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-bbefa4e4-0157-4fd4-8127-1df9131231a2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:22.064323 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-bbefa4e4-0157-4fd4-8127-1df9131231a2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:22.071032 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bbefa4e4-0157-4fd4-8127-1df9131231a2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:22.071520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bbefa4e4-0157-4fd4-8127-1df9131231a2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:22.071960 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bbefa4e4-0157-4fd4-8127-1df9131231a2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:22.072685 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bbefa4e4-0157-4fd4-8127-1df9131231a2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:22.073151 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bbefa4e4-0157-4fd4-8127-1df9131231a2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:22.073583 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bbefa4e4-0157-4fd4-8127-1df9131231a2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:22.218468 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-bbefa4e4-0157-4fd4-8127-1df9131231a2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:22.227006 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-bbefa4e4-0157-4fd4-8127-1df9131231a2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1720 microversion: 2.1 time: 0.167365 Aug 24 08:04:22.227583 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 432/862] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:22 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:23.249090 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-0d2a82fb-5279-4da7-8c24-a537c955bb58 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:23.249731 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-0d2a82fb-5279-4da7-8c24-a537c955bb58 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:23.256089 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0d2a82fb-5279-4da7-8c24-a537c955bb58 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:23.256569 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0d2a82fb-5279-4da7-8c24-a537c955bb58 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:23.257034 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0d2a82fb-5279-4da7-8c24-a537c955bb58 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:23.257720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0d2a82fb-5279-4da7-8c24-a537c955bb58 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:23.258198 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0d2a82fb-5279-4da7-8c24-a537c955bb58 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:23.258620 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0d2a82fb-5279-4da7-8c24-a537c955bb58 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:23.384409 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-0d2a82fb-5279-4da7-8c24-a537c955bb58 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:23.392720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-0d2a82fb-5279-4da7-8c24-a537c955bb58 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1720 microversion: 2.1 time: 0.148123 Aug 24 08:04:23.398687 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 431/863] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:23 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:24.414716 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-3fb860ed-2df1-4b74-be20-3c012aa04831 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:24.415334 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-3fb860ed-2df1-4b74-be20-3c012aa04831 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:24.422177 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3fb860ed-2df1-4b74-be20-3c012aa04831 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:24.422654 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3fb860ed-2df1-4b74-be20-3c012aa04831 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:24.423083 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3fb860ed-2df1-4b74-be20-3c012aa04831 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:24.423768 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3fb860ed-2df1-4b74-be20-3c012aa04831 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:24.424214 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3fb860ed-2df1-4b74-be20-3c012aa04831 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:24.424632 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3fb860ed-2df1-4b74-be20-3c012aa04831 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:24.552856 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-3fb860ed-2df1-4b74-be20-3c012aa04831 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:24.560900 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-3fb860ed-2df1-4b74-be20-3c012aa04831 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1720 microversion: 2.1 time: 0.150107 Aug 24 08:04:24.562201 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 433/864] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:24 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:25.583219 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-c5e8fe0e-0ddb-4591-8a4a-62010aa8e62c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:25.583811 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-c5e8fe0e-0ddb-4591-8a4a-62010aa8e62c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:25.590298 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c5e8fe0e-0ddb-4591-8a4a-62010aa8e62c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:25.590783 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c5e8fe0e-0ddb-4591-8a4a-62010aa8e62c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:25.591222 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c5e8fe0e-0ddb-4591-8a4a-62010aa8e62c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:25.591981 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c5e8fe0e-0ddb-4591-8a4a-62010aa8e62c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:25.592445 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c5e8fe0e-0ddb-4591-8a4a-62010aa8e62c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:25.592892 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c5e8fe0e-0ddb-4591-8a4a-62010aa8e62c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:25.721365 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-c5e8fe0e-0ddb-4591-8a4a-62010aa8e62c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:25.729711 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-c5e8fe0e-0ddb-4591-8a4a-62010aa8e62c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1720 microversion: 2.1 time: 0.150494 Aug 24 08:04:25.730276 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 432/865] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:25 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:26.750563 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-09c6a9e3-1d17-41cd-80e9-1f72c80169e3 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:26.751124 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-09c6a9e3-1d17-41cd-80e9-1f72c80169e3 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:26.757712 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-09c6a9e3-1d17-41cd-80e9-1f72c80169e3 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:26.758236 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-09c6a9e3-1d17-41cd-80e9-1f72c80169e3 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:26.758677 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-09c6a9e3-1d17-41cd-80e9-1f72c80169e3 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:26.759371 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-09c6a9e3-1d17-41cd-80e9-1f72c80169e3 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:26.759830 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-09c6a9e3-1d17-41cd-80e9-1f72c80169e3 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:26.760257 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-09c6a9e3-1d17-41cd-80e9-1f72c80169e3 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:26.895471 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-09c6a9e3-1d17-41cd-80e9-1f72c80169e3 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:26.904324 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-09c6a9e3-1d17-41cd-80e9-1f72c80169e3 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1697 microversion: 2.1 time: 0.157918 Aug 24 08:04:26.906653 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 434/866] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:26 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:26.930831 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-ea029062-8b55-441d-a4a4-32e1190b280e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:04:26.933353 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:26.937965 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ea029062-8b55-441d-a4a4-32e1190b280e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:26.938438 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ea029062-8b55-441d-a4a4-32e1190b280e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:26.938867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ea029062-8b55-441d-a4a4-32e1190b280e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:26.966453 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:27.000201 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-ea029062-8b55-441d-a4a4-32e1190b280e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Going to try to start instance {{(pid=127590) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 08:04:27.220539 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-ea029062-8b55-441d-a4a4-32e1190b280e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "POST /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be/action" status: 202 len: 0 microversion: 2.1 time: 0.293304 Aug 24 08:04:27.221176 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 433/867] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 24 08:04:26 2022] POST /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:04:27.229451 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b097008b-666b-481e-b2a1-0f77a0e3e5de tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:27.234529 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-b097008b-666b-481e-b2a1-0f77a0e3e5de tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:27.236026 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b097008b-666b-481e-b2a1-0f77a0e3e5de tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:27.236513 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b097008b-666b-481e-b2a1-0f77a0e3e5de tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:27.236985 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b097008b-666b-481e-b2a1-0f77a0e3e5de tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:27.237688 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b097008b-666b-481e-b2a1-0f77a0e3e5de tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:27.238145 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b097008b-666b-481e-b2a1-0f77a0e3e5de tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:27.238573 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b097008b-666b-481e-b2a1-0f77a0e3e5de tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:27.371642 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b097008b-666b-481e-b2a1-0f77a0e3e5de tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:27.380751 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-b097008b-666b-481e-b2a1-0f77a0e3e5de tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1706 microversion: 2.1 time: 0.155118 Aug 24 08:04:27.381732 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 435/868] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:27 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1706 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:28.403057 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-db2c6a27-776e-42ba-86be-b919bd548608 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:28.404025 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-db2c6a27-776e-42ba-86be-b919bd548608 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:28.411899 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-db2c6a27-776e-42ba-86be-b919bd548608 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:28.412387 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-db2c6a27-776e-42ba-86be-b919bd548608 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:28.412895 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-db2c6a27-776e-42ba-86be-b919bd548608 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:28.413601 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-db2c6a27-776e-42ba-86be-b919bd548608 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:28.414058 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-db2c6a27-776e-42ba-86be-b919bd548608 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:28.414488 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-db2c6a27-776e-42ba-86be-b919bd548608 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:28.545154 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-db2c6a27-776e-42ba-86be-b919bd548608 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:28.553309 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-db2c6a27-776e-42ba-86be-b919bd548608 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1706 microversion: 2.1 time: 0.154892 Aug 24 08:04:28.553876 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 434/869] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:28 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1706 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:04:29.575017 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-4525adfd-b510-4d26-80d3-2b144187921f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:04:29.575540 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-4525adfd-b510-4d26-80d3-2b144187921f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:04:29.581935 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4525adfd-b510-4d26-80d3-2b144187921f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:29.582429 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4525adfd-b510-4d26-80d3-2b144187921f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:29.582865 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4525adfd-b510-4d26-80d3-2b144187921f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:29.583565 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4525adfd-b510-4d26-80d3-2b144187921f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:04:29.584022 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4525adfd-b510-4d26-80d3-2b144187921f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:04:29.584452 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4525adfd-b510-4d26-80d3-2b144187921f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:04:29.716217 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-4525adfd-b510-4d26-80d3-2b144187921f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:04:29.725348 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-4525adfd-b510-4d26-80d3-2b144187921f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1710 microversion: 2.1 time: 0.154289 Aug 24 08:04:29.725915 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 436/870] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:04:29 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1710 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:01.707239 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-45ef9846-a481-407a-ad76-84081df54b83 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:01.707813 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-45ef9846-a481-407a-ad76-84081df54b83 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:01.709763 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=3 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:01.710420 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:01.715045 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-45ef9846-a481-407a-ad76-84081df54b83 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:01.715523 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-45ef9846-a481-407a-ad76-84081df54b83 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:01.715959 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-45ef9846-a481-407a-ad76-84081df54b83 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:01.716644 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-45ef9846-a481-407a-ad76-84081df54b83 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:01.717117 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-45ef9846-a481-407a-ad76-84081df54b83 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:01.723245 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-45ef9846-a481-407a-ad76-84081df54b83 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:01.800899 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.objects.instance [None req-45ef9846-a481-407a-ad76-84081df54b83 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lazy-loading 'services' on Instance uuid 840d9152-ac7c-4205-b159-d6151037a3be {{(pid=127590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:05:02.061090 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-45ef9846-a481-407a-ad76-84081df54b83 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "DELETE /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be/os-volume_attachments/b016474b-d0f3-40d0-8739-259cca52c79f" status: 202 len: 0 microversion: 2.1 time: 0.358324 Aug 24 08:05:02.061687 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 435/871] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 24 08:05:01 2022] DELETE /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be/os-volume_attachments/b016474b-d0f3-40d0-8739-259cca52c79f => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:05:03.179397 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-997dcccb-d96b-420c-9cb8-a075366c37ee tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:05:03.181635 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=16 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:03.182327 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:03.187002 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-997dcccb-d96b-420c-9cb8-a075366c37ee tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:03.187483 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-997dcccb-d96b-420c-9cb8-a075366c37ee tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:03.187918 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-997dcccb-d96b-420c-9cb8-a075366c37ee tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:03.210180 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-997dcccb-d96b-420c-9cb8-a075366c37ee tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Going to try to stop instance {{(pid=127589) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 08:05:03.374187 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-997dcccb-d96b-420c-9cb8-a075366c37ee tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "POST /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be/action" status: 202 len: 0 microversion: 2.1 time: 0.199168 Aug 24 08:05:03.374817 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 437/872] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 24 08:05:03 2022] POST /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 08:05:03.384988 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-2cabaa06-6b0f-4dd7-83ab-4c4b3e5ba836 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:03.385697 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-2cabaa06-6b0f-4dd7-83ab-4c4b3e5ba836 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:03.391888 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2cabaa06-6b0f-4dd7-83ab-4c4b3e5ba836 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:03.392377 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2cabaa06-6b0f-4dd7-83ab-4c4b3e5ba836 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:03.392851 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2cabaa06-6b0f-4dd7-83ab-4c4b3e5ba836 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:03.393560 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2cabaa06-6b0f-4dd7-83ab-4c4b3e5ba836 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:03.394015 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2cabaa06-6b0f-4dd7-83ab-4c4b3e5ba836 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:03.395015 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2cabaa06-6b0f-4dd7-83ab-4c4b3e5ba836 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:03.523200 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-2cabaa06-6b0f-4dd7-83ab-4c4b3e5ba836 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:03.531282 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-2cabaa06-6b0f-4dd7-83ab-4c4b3e5ba836 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1674 microversion: 2.1 time: 0.151071 Aug 24 08:05:03.531849 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 436/873] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:03 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:04.553884 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-2fe15843-4cee-41f4-97db-4eed38448a01 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:04.554611 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-2fe15843-4cee-41f4-97db-4eed38448a01 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:04.561185 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2fe15843-4cee-41f4-97db-4eed38448a01 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:04.561671 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2fe15843-4cee-41f4-97db-4eed38448a01 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:04.562139 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2fe15843-4cee-41f4-97db-4eed38448a01 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:04.562838 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2fe15843-4cee-41f4-97db-4eed38448a01 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:04.563298 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2fe15843-4cee-41f4-97db-4eed38448a01 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:04.563724 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2fe15843-4cee-41f4-97db-4eed38448a01 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:04.691654 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-2fe15843-4cee-41f4-97db-4eed38448a01 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:04.699413 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-2fe15843-4cee-41f4-97db-4eed38448a01 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1674 microversion: 2.1 time: 0.150929 Aug 24 08:05:04.699979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 438/874] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:04 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:05.719356 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-02c12540-b871-492c-a920-9969d1bdf8ee tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:05.719897 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-02c12540-b871-492c-a920-9969d1bdf8ee tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:05.726946 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-02c12540-b871-492c-a920-9969d1bdf8ee tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:05.727420 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-02c12540-b871-492c-a920-9969d1bdf8ee tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:05.727877 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-02c12540-b871-492c-a920-9969d1bdf8ee tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:05.728558 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-02c12540-b871-492c-a920-9969d1bdf8ee tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:05.729030 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-02c12540-b871-492c-a920-9969d1bdf8ee tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:05.729449 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-02c12540-b871-492c-a920-9969d1bdf8ee tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:06.115144 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-02c12540-b871-492c-a920-9969d1bdf8ee tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:06.123557 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-02c12540-b871-492c-a920-9969d1bdf8ee tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1674 microversion: 2.1 time: 0.408093 Aug 24 08:05:06.124120 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 437/875] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:05 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1674 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:07.145307 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-becfd559-52ad-499a-8547-2f987e42fd26 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:07.145904 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-becfd559-52ad-499a-8547-2f987e42fd26 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:07.152327 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-becfd559-52ad-499a-8547-2f987e42fd26 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:07.153137 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-becfd559-52ad-499a-8547-2f987e42fd26 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:07.153583 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-becfd559-52ad-499a-8547-2f987e42fd26 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:07.154280 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-becfd559-52ad-499a-8547-2f987e42fd26 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:07.154736 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-becfd559-52ad-499a-8547-2f987e42fd26 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:07.155164 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-becfd559-52ad-499a-8547-2f987e42fd26 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:07.285032 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-becfd559-52ad-499a-8547-2f987e42fd26 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:07.292810 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-becfd559-52ad-499a-8547-2f987e42fd26 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1674 microversion: 2.1 time: 0.152029 Aug 24 08:05:07.293367 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 439/876] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:07 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:08.313819 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-3c9930a0-9be2-4fa0-94fe-4632ca912271 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:08.314382 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-3c9930a0-9be2-4fa0-94fe-4632ca912271 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:08.321938 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3c9930a0-9be2-4fa0-94fe-4632ca912271 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:08.332007 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3c9930a0-9be2-4fa0-94fe-4632ca912271 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:08.332007 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3c9930a0-9be2-4fa0-94fe-4632ca912271 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:08.332007 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3c9930a0-9be2-4fa0-94fe-4632ca912271 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:08.332007 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3c9930a0-9be2-4fa0-94fe-4632ca912271 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:08.332420 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3c9930a0-9be2-4fa0-94fe-4632ca912271 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:08.462882 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-3c9930a0-9be2-4fa0-94fe-4632ca912271 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:08.470466 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-3c9930a0-9be2-4fa0-94fe-4632ca912271 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1674 microversion: 2.1 time: 0.160635 Aug 24 08:05:08.471026 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 438/877] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:08 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:09.491932 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e3eb0405-f57c-42c6-bc89-c9f409632591 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:09.492542 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-e3eb0405-f57c-42c6-bc89-c9f409632591 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:09.500251 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e3eb0405-f57c-42c6-bc89-c9f409632591 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:09.500773 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e3eb0405-f57c-42c6-bc89-c9f409632591 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:09.501223 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e3eb0405-f57c-42c6-bc89-c9f409632591 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:09.501932 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e3eb0405-f57c-42c6-bc89-c9f409632591 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:09.502390 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e3eb0405-f57c-42c6-bc89-c9f409632591 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:09.502827 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e3eb0405-f57c-42c6-bc89-c9f409632591 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:09.630474 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e3eb0405-f57c-42c6-bc89-c9f409632591 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:09.638146 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-e3eb0405-f57c-42c6-bc89-c9f409632591 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1674 microversion: 2.1 time: 0.150935 Aug 24 08:05:09.638711 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 440/878] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:09 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:10.659191 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-fc30d5d7-dd2b-44b4-8233-11e92a29ff5d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:10.659736 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-fc30d5d7-dd2b-44b4-8233-11e92a29ff5d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:10.666313 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fc30d5d7-dd2b-44b4-8233-11e92a29ff5d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:10.666777 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fc30d5d7-dd2b-44b4-8233-11e92a29ff5d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:10.667226 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fc30d5d7-dd2b-44b4-8233-11e92a29ff5d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:10.667918 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fc30d5d7-dd2b-44b4-8233-11e92a29ff5d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:10.668374 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fc30d5d7-dd2b-44b4-8233-11e92a29ff5d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:10.668842 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fc30d5d7-dd2b-44b4-8233-11e92a29ff5d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:10.797644 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-fc30d5d7-dd2b-44b4-8233-11e92a29ff5d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:10.805308 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-fc30d5d7-dd2b-44b4-8233-11e92a29ff5d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1674 microversion: 2.1 time: 0.150057 Aug 24 08:05:10.805872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 439/879] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:10 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:11.827261 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-d2c55989-c0be-47c2-8a18-721f5b2a3c8d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:11.827869 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-d2c55989-c0be-47c2-8a18-721f5b2a3c8d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:11.834990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d2c55989-c0be-47c2-8a18-721f5b2a3c8d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:11.835482 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d2c55989-c0be-47c2-8a18-721f5b2a3c8d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:11.835925 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d2c55989-c0be-47c2-8a18-721f5b2a3c8d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:11.836638 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d2c55989-c0be-47c2-8a18-721f5b2a3c8d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:11.837223 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d2c55989-c0be-47c2-8a18-721f5b2a3c8d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:11.837653 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d2c55989-c0be-47c2-8a18-721f5b2a3c8d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:11.969993 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-d2c55989-c0be-47c2-8a18-721f5b2a3c8d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:11.978412 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-d2c55989-c0be-47c2-8a18-721f5b2a3c8d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1674 microversion: 2.1 time: 0.155048 Aug 24 08:05:11.978994 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 441/880] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:11 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:12.999626 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-6f1ba1ff-005a-48e6-8d38-7424e386bc28 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:13.000344 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-6f1ba1ff-005a-48e6-8d38-7424e386bc28 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:13.007654 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6f1ba1ff-005a-48e6-8d38-7424e386bc28 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:13.014252 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6f1ba1ff-005a-48e6-8d38-7424e386bc28 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:13.014252 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6f1ba1ff-005a-48e6-8d38-7424e386bc28 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:13.014252 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6f1ba1ff-005a-48e6-8d38-7424e386bc28 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:13.014252 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6f1ba1ff-005a-48e6-8d38-7424e386bc28 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:13.014645 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6f1ba1ff-005a-48e6-8d38-7424e386bc28 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:13.152993 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-6f1ba1ff-005a-48e6-8d38-7424e386bc28 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:13.158833 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-6f1ba1ff-005a-48e6-8d38-7424e386bc28 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1674 microversion: 2.1 time: 0.163221 Aug 24 08:05:13.160160 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 440/881] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:12 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:14.187532 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b10bffc2-eb97-41ed-aa3c-1ca665c39167 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:14.188106 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-b10bffc2-eb97-41ed-aa3c-1ca665c39167 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:14.199363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b10bffc2-eb97-41ed-aa3c-1ca665c39167 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:14.199885 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b10bffc2-eb97-41ed-aa3c-1ca665c39167 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:14.200327 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b10bffc2-eb97-41ed-aa3c-1ca665c39167 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:14.201087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b10bffc2-eb97-41ed-aa3c-1ca665c39167 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:14.201540 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b10bffc2-eb97-41ed-aa3c-1ca665c39167 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:14.201960 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b10bffc2-eb97-41ed-aa3c-1ca665c39167 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:14.330300 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b10bffc2-eb97-41ed-aa3c-1ca665c39167 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:14.338107 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-b10bffc2-eb97-41ed-aa3c-1ca665c39167 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1651 microversion: 2.1 time: 0.154532 Aug 24 08:05:14.338668 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 442/882] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:14 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1651 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:14.358770 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-236d6c8a-0bb1-4340-a5d0-3980054ad28f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:05:14.366822 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-236d6c8a-0bb1-4340-a5d0-3980054ad28f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:14.366822 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-236d6c8a-0bb1-4340-a5d0-3980054ad28f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:14.367221 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-236d6c8a-0bb1-4340-a5d0-3980054ad28f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:14.389980 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-236d6c8a-0bb1-4340-a5d0-3980054ad28f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Going to try to start instance {{(pid=127590) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 08:05:14.521915 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-236d6c8a-0bb1-4340-a5d0-3980054ad28f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "POST /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be/action" status: 202 len: 0 microversion: 2.1 time: 0.166800 Aug 24 08:05:14.522431 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 441/883] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 24 08:05:14 2022] POST /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:05:14.530895 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-f4a3299f-4a90-45b3-a664-b9e00160c61b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:14.531511 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-f4a3299f-4a90-45b3-a664-b9e00160c61b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:14.538033 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f4a3299f-4a90-45b3-a664-b9e00160c61b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:14.538523 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f4a3299f-4a90-45b3-a664-b9e00160c61b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:14.538965 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f4a3299f-4a90-45b3-a664-b9e00160c61b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:14.539676 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f4a3299f-4a90-45b3-a664-b9e00160c61b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:14.540137 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f4a3299f-4a90-45b3-a664-b9e00160c61b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:14.540565 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f4a3299f-4a90-45b3-a664-b9e00160c61b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:14.706468 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-f4a3299f-4a90-45b3-a664-b9e00160c61b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:14.715774 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-f4a3299f-4a90-45b3-a664-b9e00160c61b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1660 microversion: 2.1 time: 0.188984 Aug 24 08:05:14.716342 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 443/884] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:14 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1660 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:15.737877 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-ba0c2a3e-4ab1-4fb6-a560-9b31399f39db tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:15.739008 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-ba0c2a3e-4ab1-4fb6-a560-9b31399f39db tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:15.745120 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ba0c2a3e-4ab1-4fb6-a560-9b31399f39db tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:15.745604 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ba0c2a3e-4ab1-4fb6-a560-9b31399f39db tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:15.746043 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ba0c2a3e-4ab1-4fb6-a560-9b31399f39db tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:15.746729 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ba0c2a3e-4ab1-4fb6-a560-9b31399f39db tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:15.747181 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ba0c2a3e-4ab1-4fb6-a560-9b31399f39db tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:15.747609 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ba0c2a3e-4ab1-4fb6-a560-9b31399f39db tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:15.881473 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-ba0c2a3e-4ab1-4fb6-a560-9b31399f39db tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:15.890092 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-ba0c2a3e-4ab1-4fb6-a560-9b31399f39db tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1664 microversion: 2.1 time: 0.156950 Aug 24 08:05:15.890663 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 442/885] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:15 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:23.953415 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-97eda562-fc76-47ec-9748-b05ceb2bf118 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:23.953996 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-97eda562-fc76-47ec-9748-b05ceb2bf118 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: a2a5c24f-2c38-49f9-b39c-ee1ee740e884] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:23.960042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-97eda562-fc76-47ec-9748-b05ceb2bf118 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:23.960566 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-97eda562-fc76-47ec-9748-b05ceb2bf118 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:23.961053 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-97eda562-fc76-47ec-9748-b05ceb2bf118 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:23.961760 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-97eda562-fc76-47ec-9748-b05ceb2bf118 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:23.962222 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-97eda562-fc76-47ec-9748-b05ceb2bf118 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:23.962655 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-97eda562-fc76-47ec-9748-b05ceb2bf118 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:23.987016 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-97eda562-fc76-47ec-9748-b05ceb2bf118 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: a2a5c24f-2c38-49f9-b39c-ee1ee740e884] Going to try to terminate instance {{(pid=127589) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:05:24.347128 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-97eda562-fc76-47ec-9748-b05ceb2bf118 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884" status: 204 len: 0 microversion: 2.1 time: 0.397485 Aug 24 08:05:24.347724 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 444/886] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 24 08:05:23 2022] DELETE /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:05:24.356321 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-9e6859b3-3760-4f64-a598-fd4c32a215fd tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:24.356974 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-9e6859b3-3760-4f64-a598-fd4c32a215fd tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: a2a5c24f-2c38-49f9-b39c-ee1ee740e884] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:24.363634 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e6859b3-3760-4f64-a598-fd4c32a215fd tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:24.364108 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e6859b3-3760-4f64-a598-fd4c32a215fd tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:24.364541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e6859b3-3760-4f64-a598-fd4c32a215fd tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:24.365830 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e6859b3-3760-4f64-a598-fd4c32a215fd tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:24.366365 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e6859b3-3760-4f64-a598-fd4c32a215fd tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:24.366783 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e6859b3-3760-4f64-a598-fd4c32a215fd tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:24.496956 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9e6859b3-3760-4f64-a598-fd4c32a215fd tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:24.504629 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-9e6859b3-3760-4f64-a598-fd4c32a215fd tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884" status: 200 len: 1575 microversion: 2.1 time: 0.152083 Aug 24 08:05:24.505306 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 443/887] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:24 2022] GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:25.526483 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e9825bc8-b957-4a2c-9720-61f5be3fdb33 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:25.527539 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-e9825bc8-b957-4a2c-9720-61f5be3fdb33 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: a2a5c24f-2c38-49f9-b39c-ee1ee740e884] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:25.534096 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e9825bc8-b957-4a2c-9720-61f5be3fdb33 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:25.534576 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e9825bc8-b957-4a2c-9720-61f5be3fdb33 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:25.535013 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e9825bc8-b957-4a2c-9720-61f5be3fdb33 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:25.535709 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e9825bc8-b957-4a2c-9720-61f5be3fdb33 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:25.536164 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e9825bc8-b957-4a2c-9720-61f5be3fdb33 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:25.536590 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e9825bc8-b957-4a2c-9720-61f5be3fdb33 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:25.671265 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e9825bc8-b957-4a2c-9720-61f5be3fdb33 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:25.679740 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-e9825bc8-b957-4a2c-9720-61f5be3fdb33 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884" status: 200 len: 1575 microversion: 2.1 time: 0.157556 Aug 24 08:05:25.680298 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 445/888] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:25 2022] GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:26.701173 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-b1b9da79-186b-461c-9a44-ac5c98500545 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:26.701790 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-b1b9da79-186b-461c-9a44-ac5c98500545 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: a2a5c24f-2c38-49f9-b39c-ee1ee740e884] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:26.707937 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b1b9da79-186b-461c-9a44-ac5c98500545 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:26.708465 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b1b9da79-186b-461c-9a44-ac5c98500545 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:26.709518 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b1b9da79-186b-461c-9a44-ac5c98500545 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:26.710206 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b1b9da79-186b-461c-9a44-ac5c98500545 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:26.710663 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b1b9da79-186b-461c-9a44-ac5c98500545 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:26.711090 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b1b9da79-186b-461c-9a44-ac5c98500545 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:26.891764 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-70b7393a-1544-4506-80d4-9faa71583e48 req-5ef4c686-a55b-49cc-9b64-06b4188538e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a5c24f-2c38-49f9-b39c-ee1ee740e884", "name": "network-vif-deleted", "tag": "68223bf4-fae5-411c-b20b-32c5a0298520"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:05:26.915188 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-70b7393a-1544-4506-80d4-9faa71583e48 req-5ef4c686-a55b-49cc-9b64-06b4188538e6 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:26.915684 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-70b7393a-1544-4506-80d4-9faa71583e48 req-5ef4c686-a55b-49cc-9b64-06b4188538e6 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:26.916176 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-70b7393a-1544-4506-80d4-9faa71583e48 req-5ef4c686-a55b-49cc-9b64-06b4188538e6 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:26.928451 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-70b7393a-1544-4506-80d4-9faa71583e48 req-5ef4c686-a55b-49cc-9b64-06b4188538e6 service nova] Creating event network-vif-deleted:68223bf4-fae5-411c-b20b-32c5a0298520 for instance a2a5c24f-2c38-49f9-b39c-ee1ee740e884 on hv-cinder-85427 Aug 24 08:05:26.935464 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-70b7393a-1544-4506-80d4-9faa71583e48 req-5ef4c686-a55b-49cc-9b64-06b4188538e6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047984 Aug 24 08:05:26.936832 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 446/889] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:05:27.091311 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-b1b9da79-186b-461c-9a44-ac5c98500545 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:27.101894 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-b1b9da79-186b-461c-9a44-ac5c98500545 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884" status: 200 len: 1508 microversion: 2.1 time: 0.403355 Aug 24 08:05:27.101894 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 444/890] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:26 2022] GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884 => generated 1508 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:28.122650 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-94bce934-0270-4a89-987b-4aa622036f54 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:28.123353 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-94bce934-0270-4a89-987b-4aa622036f54 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: a2a5c24f-2c38-49f9-b39c-ee1ee740e884] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:28.129673 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-94bce934-0270-4a89-987b-4aa622036f54 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:28.130168 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-94bce934-0270-4a89-987b-4aa622036f54 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:28.130612 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-94bce934-0270-4a89-987b-4aa622036f54 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:28.131831 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-94bce934-0270-4a89-987b-4aa622036f54 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:28.132289 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-94bce934-0270-4a89-987b-4aa622036f54 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:28.132756 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-94bce934-0270-4a89-987b-4aa622036f54 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:28.146090 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-94bce934-0270-4a89-987b-4aa622036f54 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] HTTP exception thrown: Instance a2a5c24f-2c38-49f9-b39c-ee1ee740e884 could not be found. Aug 24 08:05:28.148380 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-94bce934-0270-4a89-987b-4aa622036f54 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Request method failure captured: Aug 24 08:05:28.148380 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884 HTTP/1.1 Aug 24 08:05:28.148380 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 08:05:28.148380 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 08:05:28.148380 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 08:05:28.148380 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 08:05:28.148380 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 08:05:28.148380 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 08:05:28.148380 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 08:05:28.148380 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 08:05:28.148380 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdsdPE_TENCm3veCBGHBMVkAAF-Fdbt6MSosHnKKZlOzS98CVtlx90x0G-xiPcJvD9YQyT5MfwbnSW5TA76Ocnra8rvXxxZt1pbURvj0_Gxk1bElk9M8gTuaImv_cepwfC0gtCXvUS8cowmZwtmqkZRK6CIRuNlQWRQmgi-hwQRXus4 Aug 24 08:05:28.148380 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 08:05:28.148380 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 08:05:28.148380 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 08:05:28.148380 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 08:05:28.148380 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 08:05:28.148380 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 08:05:28.148380 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: 67da3e4c41e64947bb3e531c5b7550b6 Aug 24 08:05:28.148380 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-TestVolumeBootPattern-417988494 Aug 24 08:05:28.148380 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 08:05:28.148380 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 08:05:28.150061 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_67da3e4c41e64947bb3e531c5b7550b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/67da3e4c41e64947bb3e531c5b7550b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/67da3e4c41e64947bb3e531c5b7550b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/67da3e4c41e64947bb3e531c5b7550b6"}]}] Aug 24 08:05:28.150061 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-TestVolumeBootPattern-417988494 Aug 24 08:05:28.150061 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: 67da3e4c41e64947bb3e531c5b7550b6 Aug 24 08:05:28.150061 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-TestVolumeBootPattern-417988494 Aug 24 08:05:28.150061 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-TestVolumeBootPattern-417988494-project Aug 24 08:05:28.150061 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 08:05:28.150061 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 08:05:28.150061 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 7a279965532e4020876954116f53d3b9 Aug 24 08:05:28.150061 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-TestVolumeBootPattern-417988494-project Aug 24 08:05:28.150061 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 08:05:28.150061 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Instance a2a5c24f-2c38-49f9-b39c-ee1ee740e884 could not be found. Aug 24 08:05:28.150061 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': 'a2a5c24f-2c38-49f9-b39c-ee1ee740e884'} Aug 24 08:05:28.151199 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:05:28.151199 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:05:28.151199 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:05:28.151199 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:05:28.151199 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:05:28.151199 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:05:28.151199 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:05:28.151199 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:05:28.151199 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:05:28.151199 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:05:28.151199 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2a5c24f-2c38-49f9-b39c-ee1ee740e884 could not be found. Aug 24 08:05:28.151199 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:05:28.151199 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:05:28.151199 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:05:28.151199 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:05:28.151199 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:05:28.151199 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:05:28.151199 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:05:28.151199 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:05:28.151199 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:05:28.153110 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:05:28.153110 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:05:28.153110 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:05:28.153110 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:05:28.153110 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:05:28.153110 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:05:28.153110 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:05:28.153110 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2a5c24f-2c38-49f9-b39c-ee1ee740e884 could not be found. Aug 24 08:05:28.153110 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:05:28.153110 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:05:28.153110 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:05:28.153110 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:05:28.153110 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:05:28.153110 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:05:28.153110 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:05:28.153110 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:05:28.153110 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2a5c24f-2c38-49f9-b39c-ee1ee740e884 could not be found. Aug 24 08:05:28.153110 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:05:28.154535 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-94bce934-0270-4a89-987b-4aa622036f54 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Returning 404 to user: Instance a2a5c24f-2c38-49f9-b39c-ee1ee740e884 could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:05:28.154535 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-94bce934-0270-4a89-987b-4aa622036f54 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884" status: 404 len: 111 microversion: 2.1 time: 0.031992 Aug 24 08:05:28.154535 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 447/891] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:28 2022] GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:05:28.251426 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-c47d4f3e-c373-4c26-ae22-4cd84cc80f03 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1366035466", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-688278176", "security_groups": [{"name": "tempest-secgroup-smoke-812161139"}], "block_device_mapping_v2": [{"uuid": "2dcec48b-5647-4098-a409-b62c3abc3089", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ba35002a-baf9-48c9-8bd5-ed065d35dab0"}]}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:05:28.363697 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.network.neutron [None req-c47d4f3e-c373-4c26-ae22-4cd84cc80f03 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] validate_networks() for [('ba35002a-baf9-48c9-8bd5-ed065d35dab0', None, None, None, None, None)] {{(pid=127590) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:05:28.740986 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-c47d4f3e-c373-4c26-ae22-4cd84cc80f03 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Flavor limits 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:05:28.741427 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-c47d4f3e-c373-4c26-ae22-4cd84cc80f03 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Image limits 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:05:28.741901 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-c47d4f3e-c373-4c26-ae22-4cd84cc80f03 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Flavor pref 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:05:28.742311 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-c47d4f3e-c373-4c26-ae22-4cd84cc80f03 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Image pref 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:05:28.742722 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-c47d4f3e-c373-4c26-ae22-4cd84cc80f03 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:05:28.752434 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c47d4f3e-c373-4c26-ae22-4cd84cc80f03 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:28.752948 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c47d4f3e-c373-4c26-ae22-4cd84cc80f03 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:28.753416 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c47d4f3e-c373-4c26-ae22-4cd84cc80f03 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:28.754151 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c47d4f3e-c373-4c26-ae22-4cd84cc80f03 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:28.754635 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c47d4f3e-c373-4c26-ae22-4cd84cc80f03 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:28.755065 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c47d4f3e-c373-4c26-ae22-4cd84cc80f03 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:28.771606 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-c47d4f3e-c373-4c26-ae22-4cd84cc80f03 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Getting quotas for project 67da3e4c41e64947bb3e531c5b7550b6. Resources: {'cores', 'instances', 'ram'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:05:28.775548 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-c47d4f3e-c373-4c26-ae22-4cd84cc80f03 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Getting quotas for user 7a279965532e4020876954116f53d3b9 and project 67da3e4c41e64947bb3e531c5b7550b6. Resources: {'cores', 'instances', 'ram'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:05:28.831714 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-c47d4f3e-c373-4c26-ae22-4cd84cc80f03 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Going to run 1 instances... {{(pid=127590) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:05:28.833872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-c47d4f3e-c373-4c26-ae22-4cd84cc80f03 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: 8779ca69-eb57-4846-9329-508c555e1aa2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2dcec48b-5647-4098-a409-b62c3abc3089',volume_size=None,volume_type=None)] {{(pid=127590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:05:29.270818 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-c47d4f3e-c373-4c26-ae22-4cd84cc80f03 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.023287 Aug 24 08:05:29.272055 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 445/892] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 24 08:05:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 08:05:29.283145 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-d29a7fbf-643d-4185-8db4-0b75e2be6fd3 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:29.283906 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-d29a7fbf-643d-4185-8db4-0b75e2be6fd3 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: 8779ca69-eb57-4846-9329-508c555e1aa2] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:29.401508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-d29a7fbf-643d-4185-8db4-0b75e2be6fd3 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:29.413481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-d29a7fbf-643d-4185-8db4-0b75e2be6fd3 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2" status: 200 len: 1094 microversion: 2.1 time: 0.133529 Aug 24 08:05:29.414394 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 448/893] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:29 2022] GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2 => generated 1094 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:30.435137 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-a34717b5-1b6d-42b4-9da6-7e98e4ccbcb8 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:30.435748 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-a34717b5-1b6d-42b4-9da6-7e98e4ccbcb8 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: 8779ca69-eb57-4846-9329-508c555e1aa2] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:30.441909 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a34717b5-1b6d-42b4-9da6-7e98e4ccbcb8 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:30.442391 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a34717b5-1b6d-42b4-9da6-7e98e4ccbcb8 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:30.442826 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a34717b5-1b6d-42b4-9da6-7e98e4ccbcb8 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:30.443518 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a34717b5-1b6d-42b4-9da6-7e98e4ccbcb8 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:30.443967 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a34717b5-1b6d-42b4-9da6-7e98e4ccbcb8 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:30.444397 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a34717b5-1b6d-42b4-9da6-7e98e4ccbcb8 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:30.508426 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-a34717b5-1b6d-42b4-9da6-7e98e4ccbcb8 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:30.517715 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-a34717b5-1b6d-42b4-9da6-7e98e4ccbcb8 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2" status: 200 len: 1144 microversion: 2.1 time: 0.087202 Aug 24 08:05:30.518280 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 446/894] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:30 2022] GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:31.540143 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-0a6e623d-fc93-492b-ba9e-8ca922bf75b2 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:31.540876 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-0a6e623d-fc93-492b-ba9e-8ca922bf75b2 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: 8779ca69-eb57-4846-9329-508c555e1aa2] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:31.547342 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0a6e623d-fc93-492b-ba9e-8ca922bf75b2 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:31.547910 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0a6e623d-fc93-492b-ba9e-8ca922bf75b2 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:31.548353 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0a6e623d-fc93-492b-ba9e-8ca922bf75b2 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:31.549085 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0a6e623d-fc93-492b-ba9e-8ca922bf75b2 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:31.549537 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0a6e623d-fc93-492b-ba9e-8ca922bf75b2 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:31.549959 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0a6e623d-fc93-492b-ba9e-8ca922bf75b2 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:31.611665 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-0a6e623d-fc93-492b-ba9e-8ca922bf75b2 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:31.619396 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-0a6e623d-fc93-492b-ba9e-8ca922bf75b2 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2" status: 200 len: 1200 microversion: 2.1 time: 0.084007 Aug 24 08:05:31.619970 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 449/895] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:31 2022] GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2 => generated 1200 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:32.641701 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-bd3b0baf-db5a-4f71-a0e6-c5d3f95482de tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:32.647883 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-bd3b0baf-db5a-4f71-a0e6-c5d3f95482de tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: 8779ca69-eb57-4846-9329-508c555e1aa2] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:32.647883 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:32.649514 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bd3b0baf-db5a-4f71-a0e6-c5d3f95482de tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:32.649995 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bd3b0baf-db5a-4f71-a0e6-c5d3f95482de tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:32.650426 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bd3b0baf-db5a-4f71-a0e6-c5d3f95482de tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:32.651106 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bd3b0baf-db5a-4f71-a0e6-c5d3f95482de tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:32.651551 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bd3b0baf-db5a-4f71-a0e6-c5d3f95482de tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:32.652224 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bd3b0baf-db5a-4f71-a0e6-c5d3f95482de tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:32.656111 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:32.786729 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-bd3b0baf-db5a-4f71-a0e6-c5d3f95482de tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:32.796367 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-bd3b0baf-db5a-4f71-a0e6-c5d3f95482de tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2" status: 200 len: 1277 microversion: 2.1 time: 0.158391 Aug 24 08:05:32.796974 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 447/896] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:32 2022] GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2 => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:33.022336 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-845edd99-0453-40e6-a58c-0b920e4f366f req-7c15ac67-be79-4c8e-bcc4-bfc5f95e508e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8779ca69-eb57-4846-9329-508c555e1aa2", "tag": "c25e4dd6-0d08-4c34-bf00-e316e15bf38b"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:05:33.032750 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-845edd99-0453-40e6-a58c-0b920e4f366f req-7c15ac67-be79-4c8e-bcc4-bfc5f95e508e service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:33.033240 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-845edd99-0453-40e6-a58c-0b920e4f366f req-7c15ac67-be79-4c8e-bcc4-bfc5f95e508e service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:33.033673 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-845edd99-0453-40e6-a58c-0b920e4f366f req-7c15ac67-be79-4c8e-bcc4-bfc5f95e508e service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:33.047193 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-845edd99-0453-40e6-a58c-0b920e4f366f req-7c15ac67-be79-4c8e-bcc4-bfc5f95e508e service nova] Creating event network-changed:c25e4dd6-0d08-4c34-bf00-e316e15bf38b for instance 8779ca69-eb57-4846-9329-508c555e1aa2 on hv-cinder-85427 Aug 24 08:05:33.052223 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-845edd99-0453-40e6-a58c-0b920e4f366f req-7c15ac67-be79-4c8e-bcc4-bfc5f95e508e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034121 Aug 24 08:05:33.053192 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 450/897] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:05:33.817288 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-253f6022-7f0f-4660-b238-d2e64d3bdf29 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:33.817897 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-253f6022-7f0f-4660-b238-d2e64d3bdf29 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: 8779ca69-eb57-4846-9329-508c555e1aa2] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:33.826388 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-253f6022-7f0f-4660-b238-d2e64d3bdf29 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:33.826871 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-253f6022-7f0f-4660-b238-d2e64d3bdf29 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:33.827309 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-253f6022-7f0f-4660-b238-d2e64d3bdf29 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:33.827996 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-253f6022-7f0f-4660-b238-d2e64d3bdf29 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:33.828447 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-253f6022-7f0f-4660-b238-d2e64d3bdf29 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:33.828937 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-253f6022-7f0f-4660-b238-d2e64d3bdf29 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:33.964932 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-253f6022-7f0f-4660-b238-d2e64d3bdf29 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:33.972592 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-253f6022-7f0f-4660-b238-d2e64d3bdf29 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2" status: 200 len: 1265 microversion: 2.1 time: 0.159340 Aug 24 08:05:33.973180 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 448/898] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:33 2022] GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:34.995538 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-ef2e041d-f47a-4cc4-bb4f-b8505b2a67f7 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:34.996264 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-ef2e041d-f47a-4cc4-bb4f-b8505b2a67f7 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: 8779ca69-eb57-4846-9329-508c555e1aa2] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:34.998388 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:35.003624 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ef2e041d-f47a-4cc4-bb4f-b8505b2a67f7 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:35.004107 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ef2e041d-f47a-4cc4-bb4f-b8505b2a67f7 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:35.004543 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ef2e041d-f47a-4cc4-bb4f-b8505b2a67f7 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:35.005334 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ef2e041d-f47a-4cc4-bb4f-b8505b2a67f7 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:35.006292 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ef2e041d-f47a-4cc4-bb4f-b8505b2a67f7 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:35.006709 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ef2e041d-f47a-4cc4-bb4f-b8505b2a67f7 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:35.009323 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:35.141689 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-ef2e041d-f47a-4cc4-bb4f-b8505b2a67f7 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:35.149458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-ef2e041d-f47a-4cc4-bb4f-b8505b2a67f7 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2" status: 200 len: 1265 microversion: 2.1 time: 0.158815 Aug 24 08:05:35.150019 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 451/899] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:34 2022] GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:05:36.169840 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-a11c398a-14b1-409c-9df1-5d8995c59835 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:36.170444 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-a11c398a-14b1-409c-9df1-5d8995c59835 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: 8779ca69-eb57-4846-9329-508c555e1aa2] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:36.177338 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a11c398a-14b1-409c-9df1-5d8995c59835 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:36.177827 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a11c398a-14b1-409c-9df1-5d8995c59835 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:36.178266 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a11c398a-14b1-409c-9df1-5d8995c59835 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:36.178964 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a11c398a-14b1-409c-9df1-5d8995c59835 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:36.179421 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a11c398a-14b1-409c-9df1-5d8995c59835 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:36.179848 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a11c398a-14b1-409c-9df1-5d8995c59835 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:36.309821 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-a11c398a-14b1-409c-9df1-5d8995c59835 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:36.317671 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-a11c398a-14b1-409c-9df1-5d8995c59835 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2" status: 200 len: 1265 microversion: 2.1 time: 0.151720 Aug 24 08:05:36.318738 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 449/900] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:36 2022] GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:37.339235 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-568a1de1-007a-4843-ba0e-61e6a347fea6 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:37.339879 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-568a1de1-007a-4843-ba0e-61e6a347fea6 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: 8779ca69-eb57-4846-9329-508c555e1aa2] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:37.346396 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-568a1de1-007a-4843-ba0e-61e6a347fea6 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:37.346885 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-568a1de1-007a-4843-ba0e-61e6a347fea6 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:37.347328 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-568a1de1-007a-4843-ba0e-61e6a347fea6 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:37.348032 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-568a1de1-007a-4843-ba0e-61e6a347fea6 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:37.348492 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-568a1de1-007a-4843-ba0e-61e6a347fea6 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:37.348954 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-568a1de1-007a-4843-ba0e-61e6a347fea6 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:37.481605 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-568a1de1-007a-4843-ba0e-61e6a347fea6 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:37.489493 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-568a1de1-007a-4843-ba0e-61e6a347fea6 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2" status: 200 len: 1265 microversion: 2.1 time: 0.154696 Aug 24 08:05:37.490056 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 452/901] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:37 2022] GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:38.510103 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-4ec78fef-a01c-40c7-8129-60b7a344f9a2 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:38.510910 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-4ec78fef-a01c-40c7-8129-60b7a344f9a2 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: 8779ca69-eb57-4846-9329-508c555e1aa2] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:38.517569 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4ec78fef-a01c-40c7-8129-60b7a344f9a2 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:38.518047 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4ec78fef-a01c-40c7-8129-60b7a344f9a2 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:38.518479 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4ec78fef-a01c-40c7-8129-60b7a344f9a2 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:38.519166 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4ec78fef-a01c-40c7-8129-60b7a344f9a2 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:38.519611 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4ec78fef-a01c-40c7-8129-60b7a344f9a2 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:38.520051 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4ec78fef-a01c-40c7-8129-60b7a344f9a2 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:38.647512 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-4ec78fef-a01c-40c7-8129-60b7a344f9a2 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:38.655382 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-4ec78fef-a01c-40c7-8129-60b7a344f9a2 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2" status: 200 len: 1265 microversion: 2.1 time: 0.149236 Aug 24 08:05:38.655948 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 450/902] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:38 2022] GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:39.676781 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-8dc19f66-7827-41e4-9137-062ee20fa258 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:39.677389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-8dc19f66-7827-41e4-9137-062ee20fa258 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: 8779ca69-eb57-4846-9329-508c555e1aa2] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:39.680224 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=2 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:39.684984 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8dc19f66-7827-41e4-9137-062ee20fa258 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:39.685474 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8dc19f66-7827-41e4-9137-062ee20fa258 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:39.685914 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8dc19f66-7827-41e4-9137-062ee20fa258 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:39.686620 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8dc19f66-7827-41e4-9137-062ee20fa258 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:39.687088 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8dc19f66-7827-41e4-9137-062ee20fa258 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:39.687514 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8dc19f66-7827-41e4-9137-062ee20fa258 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:39.822281 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-8dc19f66-7827-41e4-9137-062ee20fa258 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:39.830273 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-8dc19f66-7827-41e4-9137-062ee20fa258 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2" status: 200 len: 1265 microversion: 2.1 time: 0.157407 Aug 24 08:05:39.830828 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 453/903] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:39 2022] GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:05:40.850793 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-311e8820-d67c-4847-ab62-de4e9c92dc4f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:40.851442 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-311e8820-d67c-4847-ab62-de4e9c92dc4f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: 8779ca69-eb57-4846-9329-508c555e1aa2] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:40.853811 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=2 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:40.854484 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=6 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:40.859664 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-311e8820-d67c-4847-ab62-de4e9c92dc4f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:40.860154 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-311e8820-d67c-4847-ab62-de4e9c92dc4f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:40.860596 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-311e8820-d67c-4847-ab62-de4e9c92dc4f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:40.861312 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-311e8820-d67c-4847-ab62-de4e9c92dc4f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:40.861769 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-311e8820-d67c-4847-ab62-de4e9c92dc4f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:40.866567 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-311e8820-d67c-4847-ab62-de4e9c92dc4f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:41.007923 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-311e8820-d67c-4847-ab62-de4e9c92dc4f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:41.015719 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-311e8820-d67c-4847-ab62-de4e9c92dc4f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2" status: 200 len: 1265 microversion: 2.1 time: 0.168784 Aug 24 08:05:41.016279 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 451/904] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:40 2022] GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:42.037416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-6cff5cd0-3c74-41ec-9b21-7a51f092a13b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:42.038022 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-6cff5cd0-3c74-41ec-9b21-7a51f092a13b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: 8779ca69-eb57-4846-9329-508c555e1aa2] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:42.044514 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6cff5cd0-3c74-41ec-9b21-7a51f092a13b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:42.045012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6cff5cd0-3c74-41ec-9b21-7a51f092a13b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:42.045446 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6cff5cd0-3c74-41ec-9b21-7a51f092a13b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:42.046420 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6cff5cd0-3c74-41ec-9b21-7a51f092a13b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:42.046876 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6cff5cd0-3c74-41ec-9b21-7a51f092a13b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:42.047294 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6cff5cd0-3c74-41ec-9b21-7a51f092a13b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:42.179056 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-6cff5cd0-3c74-41ec-9b21-7a51f092a13b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:42.187257 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-6cff5cd0-3c74-41ec-9b21-7a51f092a13b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2" status: 200 len: 1265 microversion: 2.1 time: 0.154103 Aug 24 08:05:42.187815 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 454/905] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:42 2022] GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:43.208139 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-13627c6b-5dbf-422f-b3a7-359abe2c6e2f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:43.208696 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-13627c6b-5dbf-422f-b3a7-359abe2c6e2f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: 8779ca69-eb57-4846-9329-508c555e1aa2] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:43.215590 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-13627c6b-5dbf-422f-b3a7-359abe2c6e2f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:43.216098 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-13627c6b-5dbf-422f-b3a7-359abe2c6e2f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:43.216533 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-13627c6b-5dbf-422f-b3a7-359abe2c6e2f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:43.217253 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-13627c6b-5dbf-422f-b3a7-359abe2c6e2f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:43.217708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-13627c6b-5dbf-422f-b3a7-359abe2c6e2f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:43.218133 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-13627c6b-5dbf-422f-b3a7-359abe2c6e2f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:43.360925 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:05:43.361515 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Wed Aug 24 08:05:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:05:43.503791 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-13627c6b-5dbf-422f-b3a7-359abe2c6e2f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:43.513057 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-13627c6b-5dbf-422f-b3a7-359abe2c6e2f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2" status: 200 len: 1265 microversion: 2.1 time: 0.308647 Aug 24 08:05:43.513739 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 452/906] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:43 2022] GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2 => generated 1265 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:43.781369 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-bfd6c96e-edb6-4e09-9d65-f11cc8bdde4d req-08734d5f-57a9-4b9b-bd0e-d0f5accccc00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8779ca69-eb57-4846-9329-508c555e1aa2", "name": "network-vif-plugged", "status": "completed", "tag": "c25e4dd6-0d08-4c34-bf00-e316e15bf38b"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:05:43.792769 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-bfd6c96e-edb6-4e09-9d65-f11cc8bdde4d req-08734d5f-57a9-4b9b-bd0e-d0f5accccc00 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:43.793251 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-bfd6c96e-edb6-4e09-9d65-f11cc8bdde4d req-08734d5f-57a9-4b9b-bd0e-d0f5accccc00 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:43.793682 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-bfd6c96e-edb6-4e09-9d65-f11cc8bdde4d req-08734d5f-57a9-4b9b-bd0e-d0f5accccc00 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:43.803878 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-bfd6c96e-edb6-4e09-9d65-f11cc8bdde4d req-08734d5f-57a9-4b9b-bd0e-d0f5accccc00 service nova] Creating event network-vif-plugged:c25e4dd6-0d08-4c34-bf00-e316e15bf38b for instance 8779ca69-eb57-4846-9329-508c555e1aa2 on hv-cinder-85427 Aug 24 08:05:43.810082 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-bfd6c96e-edb6-4e09-9d65-f11cc8bdde4d req-08734d5f-57a9-4b9b-bd0e-d0f5accccc00 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032652 Aug 24 08:05:43.810666 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 455/907] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:05:44.533945 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-f4fc017a-3d0d-4cf2-b2f7-4cf9c104ecb0 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:44.534550 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-f4fc017a-3d0d-4cf2-b2f7-4cf9c104ecb0 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: 8779ca69-eb57-4846-9329-508c555e1aa2] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:44.540906 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f4fc017a-3d0d-4cf2-b2f7-4cf9c104ecb0 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:44.541388 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f4fc017a-3d0d-4cf2-b2f7-4cf9c104ecb0 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:44.541825 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f4fc017a-3d0d-4cf2-b2f7-4cf9c104ecb0 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:44.542510 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f4fc017a-3d0d-4cf2-b2f7-4cf9c104ecb0 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:44.542966 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f4fc017a-3d0d-4cf2-b2f7-4cf9c104ecb0 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:44.543399 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f4fc017a-3d0d-4cf2-b2f7-4cf9c104ecb0 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:44.676550 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-f4fc017a-3d0d-4cf2-b2f7-4cf9c104ecb0 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:44.684263 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-f4fc017a-3d0d-4cf2-b2f7-4cf9c104ecb0 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2" status: 200 len: 1265 microversion: 2.1 time: 0.154172 Aug 24 08:05:44.684831 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 453/908] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:44 2022] GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:45.705894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-8b202d7f-7d86-4cf4-8fad-cb0ad89b1903 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:45.706592 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-8b202d7f-7d86-4cf4-8fad-cb0ad89b1903 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: 8779ca69-eb57-4846-9329-508c555e1aa2] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:45.713834 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8b202d7f-7d86-4cf4-8fad-cb0ad89b1903 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:45.714318 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8b202d7f-7d86-4cf4-8fad-cb0ad89b1903 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:45.714752 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8b202d7f-7d86-4cf4-8fad-cb0ad89b1903 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:45.715444 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8b202d7f-7d86-4cf4-8fad-cb0ad89b1903 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:45.715897 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8b202d7f-7d86-4cf4-8fad-cb0ad89b1903 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:45.716319 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8b202d7f-7d86-4cf4-8fad-cb0ad89b1903 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:45.845236 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-8b202d7f-7d86-4cf4-8fad-cb0ad89b1903 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:45.853491 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-8b202d7f-7d86-4cf4-8fad-cb0ad89b1903 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2" status: 200 len: 1452 microversion: 2.1 time: 0.151869 Aug 24 08:05:45.854055 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 456/909] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:45 2022] GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:45.873612 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-68be74d2-c009-4b0e-8630-ab64fe3132eb tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:45.874213 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-68be74d2-c009-4b0e-8630-ab64fe3132eb tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: 8779ca69-eb57-4846-9329-508c555e1aa2] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:45.880774 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-68be74d2-c009-4b0e-8630-ab64fe3132eb tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:45.881249 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-68be74d2-c009-4b0e-8630-ab64fe3132eb tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:45.881692 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-68be74d2-c009-4b0e-8630-ab64fe3132eb tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:45.882361 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-68be74d2-c009-4b0e-8630-ab64fe3132eb tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:45.882806 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-68be74d2-c009-4b0e-8630-ab64fe3132eb tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:45.883227 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-68be74d2-c009-4b0e-8630-ab64fe3132eb tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:46.010399 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-68be74d2-c009-4b0e-8630-ab64fe3132eb tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:46.018077 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-68be74d2-c009-4b0e-8630-ab64fe3132eb tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2" status: 200 len: 1452 microversion: 2.1 time: 0.148247 Aug 24 08:05:46.018630 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 454/910] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:45 2022] GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:47.854965 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-eb303176-0489-4094-ad88-f8ee335d2c61 req-9254a341-587b-41aa-b5bf-af2dafdce9b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8779ca69-eb57-4846-9329-508c555e1aa2", "tag": "c25e4dd6-0d08-4c34-bf00-e316e15bf38b"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:05:47.864634 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-eb303176-0489-4094-ad88-f8ee335d2c61 req-9254a341-587b-41aa-b5bf-af2dafdce9b3 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:47.865147 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-eb303176-0489-4094-ad88-f8ee335d2c61 req-9254a341-587b-41aa-b5bf-af2dafdce9b3 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:47.865580 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-eb303176-0489-4094-ad88-f8ee335d2c61 req-9254a341-587b-41aa-b5bf-af2dafdce9b3 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:47.879389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-eb303176-0489-4094-ad88-f8ee335d2c61 req-9254a341-587b-41aa-b5bf-af2dafdce9b3 service nova] Creating event network-changed:c25e4dd6-0d08-4c34-bf00-e316e15bf38b for instance 8779ca69-eb57-4846-9329-508c555e1aa2 on hv-cinder-85427 Aug 24 08:05:47.884917 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-eb303176-0489-4094-ad88-f8ee335d2c61 req-9254a341-587b-41aa-b5bf-af2dafdce9b3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034163 Aug 24 08:05:47.885792 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 457/911] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:05:48.327743 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-3d2c8fbd-949d-481b-8d45-6457cbaec3f1 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:48.330353 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-3d2c8fbd-949d-481b-8d45-6457cbaec3f1 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:48.338547 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3d2c8fbd-949d-481b-8d45-6457cbaec3f1 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:48.339324 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3d2c8fbd-949d-481b-8d45-6457cbaec3f1 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:48.339747 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3d2c8fbd-949d-481b-8d45-6457cbaec3f1 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:48.340640 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3d2c8fbd-949d-481b-8d45-6457cbaec3f1 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:48.341287 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3d2c8fbd-949d-481b-8d45-6457cbaec3f1 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:48.341709 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3d2c8fbd-949d-481b-8d45-6457cbaec3f1 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:48.373213 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-3d2c8fbd-949d-481b-8d45-6457cbaec3f1 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052066 Aug 24 08:05:48.374052 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 455/912] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 24 08:05:48 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 08:05:48.451126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-d91921b2-f632-4d33-ae7d-9a8c780fba6d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:48.451797 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-d91921b2-f632-4d33-ae7d-9a8c780fba6d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:48.458286 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d91921b2-f632-4d33-ae7d-9a8c780fba6d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:48.458895 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d91921b2-f632-4d33-ae7d-9a8c780fba6d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:48.459424 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d91921b2-f632-4d33-ae7d-9a8c780fba6d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:48.460219 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d91921b2-f632-4d33-ae7d-9a8c780fba6d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:48.461544 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d91921b2-f632-4d33-ae7d-9a8c780fba6d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:48.462044 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d91921b2-f632-4d33-ae7d-9a8c780fba6d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:48.487377 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-d91921b2-f632-4d33-ae7d-9a8c780fba6d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Going to try to terminate instance {{(pid=127589) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:05:48.764082 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-d91921b2-f632-4d33-ae7d-9a8c780fba6d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "DELETE /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 204 len: 0 microversion: 2.1 time: 0.317100 Aug 24 08:05:48.766453 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 458/913] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 24 08:05:48 2022] DELETE /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:05:48.773853 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-296c6be6-a2f0-4900-a754-1398c172042f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:48.774560 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-296c6be6-a2f0-4900-a754-1398c172042f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:48.781328 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-296c6be6-a2f0-4900-a754-1398c172042f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:48.781819 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-296c6be6-a2f0-4900-a754-1398c172042f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:48.782383 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-296c6be6-a2f0-4900-a754-1398c172042f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:48.783091 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-296c6be6-a2f0-4900-a754-1398c172042f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:48.783574 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-296c6be6-a2f0-4900-a754-1398c172042f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:48.784001 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-296c6be6-a2f0-4900-a754-1398c172042f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:48.915244 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-296c6be6-a2f0-4900-a754-1398c172042f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:48.923489 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-296c6be6-a2f0-4900-a754-1398c172042f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1670 microversion: 2.1 time: 0.153702 Aug 24 08:05:48.923979 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 456/914] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:48 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:49.946725 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-80732f81-3498-48e0-b43d-7af84ceb211e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:49.947427 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-80732f81-3498-48e0-b43d-7af84ceb211e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:49.953491 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-80732f81-3498-48e0-b43d-7af84ceb211e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:49.953979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-80732f81-3498-48e0-b43d-7af84ceb211e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:49.954419 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-80732f81-3498-48e0-b43d-7af84ceb211e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:49.955116 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-80732f81-3498-48e0-b43d-7af84ceb211e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:49.955570 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-80732f81-3498-48e0-b43d-7af84ceb211e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:49.955995 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-80732f81-3498-48e0-b43d-7af84ceb211e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:50.088051 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-80732f81-3498-48e0-b43d-7af84ceb211e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:50.095875 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-80732f81-3498-48e0-b43d-7af84ceb211e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1670 microversion: 2.1 time: 0.154122 Aug 24 08:05:50.096425 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 459/915] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:49 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:51.116366 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-e31ade5a-628d-449a-8603-0b2fbe49a4bd tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:51.118366 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-e31ade5a-628d-449a-8603-0b2fbe49a4bd tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:51.124600 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e31ade5a-628d-449a-8603-0b2fbe49a4bd tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:51.125125 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e31ade5a-628d-449a-8603-0b2fbe49a4bd tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:51.125566 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e31ade5a-628d-449a-8603-0b2fbe49a4bd tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:51.126265 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e31ade5a-628d-449a-8603-0b2fbe49a4bd tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:51.126725 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e31ade5a-628d-449a-8603-0b2fbe49a4bd tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:51.127155 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e31ade5a-628d-449a-8603-0b2fbe49a4bd tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:51.255313 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-e31ade5a-628d-449a-8603-0b2fbe49a4bd tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:51.263139 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-e31ade5a-628d-449a-8603-0b2fbe49a4bd tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1670 microversion: 2.1 time: 0.150620 Aug 24 08:05:51.263944 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 457/916] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:51 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1670 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:51.809920 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-94cd8e04-36ab-4a18-b7b6-43ea10811854 req-75c4cec5-882c-48ed-b922-3be98d879165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "840d9152-ac7c-4205-b159-d6151037a3be", "name": "network-vif-deleted", "tag": "43d8f622-820b-42da-a0f0-3f89f04d79a0"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:05:51.824470 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-94cd8e04-36ab-4a18-b7b6-43ea10811854 req-75c4cec5-882c-48ed-b922-3be98d879165 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:51.828312 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-94cd8e04-36ab-4a18-b7b6-43ea10811854 req-75c4cec5-882c-48ed-b922-3be98d879165 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:51.828312 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-94cd8e04-36ab-4a18-b7b6-43ea10811854 req-75c4cec5-882c-48ed-b922-3be98d879165 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:51.837501 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-94cd8e04-36ab-4a18-b7b6-43ea10811854 req-75c4cec5-882c-48ed-b922-3be98d879165 service nova] Creating event network-vif-deleted:43d8f622-820b-42da-a0f0-3f89f04d79a0 for instance 840d9152-ac7c-4205-b159-d6151037a3be on hv-cinder-85427 Aug 24 08:05:51.842686 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-94cd8e04-36ab-4a18-b7b6-43ea10811854 req-75c4cec5-882c-48ed-b922-3be98d879165 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036422 Aug 24 08:05:51.843284 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 460/917] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:05:52.284615 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-a2b59599-5fcd-48fb-932d-400e8a0ccaec tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:52.285315 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-a2b59599-5fcd-48fb-932d-400e8a0ccaec tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:52.292331 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a2b59599-5fcd-48fb-932d-400e8a0ccaec tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:52.292891 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a2b59599-5fcd-48fb-932d-400e8a0ccaec tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:52.293340 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a2b59599-5fcd-48fb-932d-400e8a0ccaec tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:52.294056 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a2b59599-5fcd-48fb-932d-400e8a0ccaec tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:52.294513 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a2b59599-5fcd-48fb-932d-400e8a0ccaec tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:52.294975 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a2b59599-5fcd-48fb-932d-400e8a0ccaec tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:52.328048 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a2b59599-5fcd-48fb-932d-400e8a0ccaec tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:52.328539 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a2b59599-5fcd-48fb-932d-400e8a0ccaec tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:52.329010 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a2b59599-5fcd-48fb-932d-400e8a0ccaec tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:52.329455 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.objects.instance [None req-a2b59599-5fcd-48fb-932d-400e8a0ccaec tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lazy-loading 'fault' on Instance uuid 840d9152-ac7c-4205-b159-d6151037a3be {{(pid=127590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:05:52.378203 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-a2b59599-5fcd-48fb-932d-400e8a0ccaec tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:52.387191 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-a2b59599-5fcd-48fb-932d-400e8a0ccaec tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 200 len: 1327 microversion: 2.1 time: 0.106434 Aug 24 08:05:52.387845 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 458/918] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:52 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 1327 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:53.409107 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-5c80a352-e6fd-4e53-b4cb-91637ece72da tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:53.409870 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-5c80a352-e6fd-4e53-b4cb-91637ece72da tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:53.417114 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c80a352-e6fd-4e53-b4cb-91637ece72da tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:53.417598 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c80a352-e6fd-4e53-b4cb-91637ece72da tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:53.418035 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c80a352-e6fd-4e53-b4cb-91637ece72da tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:53.418794 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c80a352-e6fd-4e53-b4cb-91637ece72da tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:53.419247 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c80a352-e6fd-4e53-b4cb-91637ece72da tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:53.419672 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5c80a352-e6fd-4e53-b4cb-91637ece72da tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:53.432897 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-5c80a352-e6fd-4e53-b4cb-91637ece72da tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] HTTP exception thrown: Instance 840d9152-ac7c-4205-b159-d6151037a3be could not be found. Aug 24 08:05:53.434508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-5c80a352-e6fd-4e53-b4cb-91637ece72da tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Request method failure captured: Aug 24 08:05:53.434508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be HTTP/1.1 Aug 24 08:05:53.434508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 08:05:53.434508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 08:05:53.434508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 08:05:53.434508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 08:05:53.434508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 08:05:53.434508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 08:05:53.434508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 08:05:53.434508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 08:05:53.434508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdtB8wg4xoATMZUNjy9gDWlG957s7r1lTlMyaQau4EdGEqi-F0s8v1oVa0_NdU26sHO4_YgFT0_VInMP9OLpHuqoP64dfsEuBEPzjsDqYspXwBR-NmoFPBnV18jLOmhWzTuIdL7GDg4xSQXFZKLeBOO3ckV29yKRXUxhmEN99EpbE2A Aug 24 08:05:53.434508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 08:05:53.434508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 08:05:53.434508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 08:05:53.434508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 08:05:53.434508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 08:05:53.434508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 08:05:53.434508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: ef79c9df5a2541afaeff1a82b3e4a496 Aug 24 08:05:53.434508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-AttachVolumeTestJSON-2104148936 Aug 24 08:05:53.434508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 08:05:53.434508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 08:05:53.436392 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ef79c9df5a2541afaeff1a82b3e4a496"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ef79c9df5a2541afaeff1a82b3e4a496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ef79c9df5a2541afaeff1a82b3e4a496"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ef79c9df5a2541afaeff1a82b3e4a496"}]}] Aug 24 08:05:53.436392 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-AttachVolumeTestJSON-2104148936 Aug 24 08:05:53.436392 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: ef79c9df5a2541afaeff1a82b3e4a496 Aug 24 08:05:53.436392 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2104148936 Aug 24 08:05:53.436392 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-AttachVolumeTestJSON-2104148936-project Aug 24 08:05:53.436392 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 08:05:53.436392 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 08:05:53.436392 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: a590d584ed654ca399875a5e04a57a24 Aug 24 08:05:53.436392 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-AttachVolumeTestJSON-2104148936-project Aug 24 08:05:53.436392 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 08:05:53.436392 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Instance 840d9152-ac7c-4205-b159-d6151037a3be could not be found. Aug 24 08:05:53.436392 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': '840d9152-ac7c-4205-b159-d6151037a3be'} Aug 24 08:05:53.437403 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:05:53.437403 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:05:53.437403 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:05:53.437403 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:05:53.437403 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:05:53.437403 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:05:53.437403 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:05:53.437403 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:05:53.437403 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:05:53.437403 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:05:53.437403 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 840d9152-ac7c-4205-b159-d6151037a3be could not be found. Aug 24 08:05:53.437403 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:05:53.437403 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:05:53.437403 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:05:53.437403 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:05:53.437403 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:05:53.437403 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:05:53.437403 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:05:53.437403 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:05:53.437403 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:05:53.438945 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:05:53.438945 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:05:53.438945 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:05:53.438945 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:05:53.438945 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:05:53.438945 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:05:53.438945 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:05:53.438945 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 840d9152-ac7c-4205-b159-d6151037a3be could not be found. Aug 24 08:05:53.438945 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:05:53.438945 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:05:53.438945 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:05:53.438945 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:05:53.438945 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:05:53.438945 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:05:53.438945 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:05:53.438945 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:05:53.438945 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 840d9152-ac7c-4205-b159-d6151037a3be could not be found. Aug 24 08:05:53.438945 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:05:53.440416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-5c80a352-e6fd-4e53-b4cb-91637ece72da tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Returning 404 to user: Instance 840d9152-ac7c-4205-b159-d6151037a3be could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:05:53.440416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-5c80a352-e6fd-4e53-b4cb-91637ece72da tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 404 len: 111 microversion: 2.1 time: 0.031166 Aug 24 08:05:53.440416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 461/919] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:53 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:05:53.445812 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-50ac9103-ffe6-4899-b2a9-9fd229a33d9c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '.version_select at 0x7f320c31d820>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:53.536007 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-50ac9103-ffe6-4899-b2a9-9fd229a33d9c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1107865553" status: 202 len: 0 microversion: 2.1 time: 0.094421 Aug 24 08:05:53.536569 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 459/920] 10.222.0.72 () {58 vars in 1221 bytes} [Wed Aug 24 08:05:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1107865553 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:05:54.243818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-8ad63e7a-e22e-47ed-8c03-0359ddd542d2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Action: 'create', calling method: .version_select at 0x7f320cb584c0>, body: {"keypair": {"name": "tempest-keypair-460613901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrR80esfyAxu9ntiF+WuITvRp1PTe1N6+4dTnAZFkABpKAfRjJzvcK7GgGQsZDhbaowY1OROTf0X7ipQWGLIhlPZWEJLkH/d3upKxBBLUHa0VWa9sb1WrGMw1c5HTNg3Q=="}} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:05:54.264110 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.quota [None req-8ad63e7a-e22e-47ed-8c03-0359ddd542d2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Getting quotas for project ef79c9df5a2541afaeff1a82b3e4a496. Resources: {'key_pairs'} {{(pid=127589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:05:54.268045 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.quota [None req-8ad63e7a-e22e-47ed-8c03-0359ddd542d2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Getting quotas for user a590d584ed654ca399875a5e04a57a24 and project ef79c9df5a2541afaeff1a82b3e4a496. Resources: {'key_pairs'} {{(pid=127589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:05:54.281312 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8ad63e7a-e22e-47ed-8c03-0359ddd542d2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [e025a84d-47ab-4b1a-84cf-c1ad519a9275] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 08:05:55.289184 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO oslo.messaging._drivers.impl_rabbit [None req-8ad63e7a-e22e-47ed-8c03-0359ddd542d2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [e025a84d-47ab-4b1a-84cf-c1ad519a9275] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 34420. Aug 24 08:05:55.381880 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-8ad63e7a-e22e-47ed-8c03-0359ddd542d2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.141980 Aug 24 08:05:55.385788 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 462/921] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 24 08:05:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:05:57.497650 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-abdc6620-ad21-4d78-a32a-b63484861d5f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1691545721", "imageRef": "ccdab334-55ce-4ff5-bd97-5a424660c282", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41e052c0-6ffd-41bd-913f-82327ff6b46b"}], "security_groups": [{"name": "tempest-securitygroup--1866570935"}], "key_name": "tempest-keypair-460613901", "user_data": "}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:05:57.598815 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.network.neutron [None req-abdc6620-ad21-4d78-a32a-b63484861d5f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] validate_networks() for [('41e052c0-6ffd-41bd-913f-82327ff6b46b', None, None, None, None, None)] {{(pid=127590) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:05:57.976587 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-abdc6620-ad21-4d78-a32a-b63484861d5f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Flavor limits 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:05:57.977276 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-abdc6620-ad21-4d78-a32a-b63484861d5f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Image limits 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:05:57.977981 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-abdc6620-ad21-4d78-a32a-b63484861d5f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Flavor pref 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:05:57.978391 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-abdc6620-ad21-4d78-a32a-b63484861d5f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Image pref 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:05:57.978801 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-abdc6620-ad21-4d78-a32a-b63484861d5f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:05:57.987655 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-abdc6620-ad21-4d78-a32a-b63484861d5f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:57.988137 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-abdc6620-ad21-4d78-a32a-b63484861d5f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:57.988572 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-abdc6620-ad21-4d78-a32a-b63484861d5f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:57.989334 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-abdc6620-ad21-4d78-a32a-b63484861d5f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:57.989789 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-abdc6620-ad21-4d78-a32a-b63484861d5f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:57.990214 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-abdc6620-ad21-4d78-a32a-b63484861d5f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:58.013504 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-abdc6620-ad21-4d78-a32a-b63484861d5f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Getting quotas for project ef79c9df5a2541afaeff1a82b3e4a496. Resources: {'cores', 'instances', 'ram'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:05:58.019682 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-abdc6620-ad21-4d78-a32a-b63484861d5f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Getting quotas for user a590d584ed654ca399875a5e04a57a24 and project ef79c9df5a2541afaeff1a82b3e4a496. Resources: {'cores', 'instances', 'ram'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:05:58.035365 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-abdc6620-ad21-4d78-a32a-b63484861d5f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Going to run 1 instances... {{(pid=127590) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:05:58.037753 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-abdc6620-ad21-4d78-a32a-b63484861d5f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccdab334-55ce-4ff5-bd97-5a424660c282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:05:58.171134 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-abdc6620-ad21-4d78-a32a-b63484861d5f tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.678206 Aug 24 08:05:58.171683 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 460/922] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 24 08:05:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 08:05:58.183000 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-7503a542-fe62-4a2d-951c-03b6e0d63255 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:58.183614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-7503a542-fe62-4a2d-951c-03b6e0d63255 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:58.242680 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-7503a542-fe62-4a2d-951c-03b6e0d63255 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:58.250302 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-7503a542-fe62-4a2d-951c-03b6e0d63255 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e" status: 200 len: 1237 microversion: 2.1 time: 0.071742 Aug 24 08:05:58.251070 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 463/923] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:58 2022] GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:05:59.272245 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-c569f6a5-56a3-43d6-910a-318f9cd37c40 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:05:59.272924 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-c569f6a5-56a3-43d6-910a-318f9cd37c40 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:05:59.280107 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c569f6a5-56a3-43d6-910a-318f9cd37c40 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:59.280601 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c569f6a5-56a3-43d6-910a-318f9cd37c40 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:59.281171 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c569f6a5-56a3-43d6-910a-318f9cd37c40 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:59.281879 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c569f6a5-56a3-43d6-910a-318f9cd37c40 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:05:59.282332 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c569f6a5-56a3-43d6-910a-318f9cd37c40 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:05:59.282762 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c569f6a5-56a3-43d6-910a-318f9cd37c40 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:05:59.349191 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-c569f6a5-56a3-43d6-910a-318f9cd37c40 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:05:59.357345 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-c569f6a5-56a3-43d6-910a-318f9cd37c40 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e" status: 200 len: 1241 microversion: 2.1 time: 0.089953 Aug 24 08:05:59.360227 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 461/924] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:05:59 2022] GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:06:00.386713 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-8f59bd19-df8c-4e83-bf7c-4aca51f45457 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:06:00.387373 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-8f59bd19-df8c-4e83-bf7c-4aca51f45457 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:06:00.395664 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8f59bd19-df8c-4e83-bf7c-4aca51f45457 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:00.396169 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8f59bd19-df8c-4e83-bf7c-4aca51f45457 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:00.396612 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8f59bd19-df8c-4e83-bf7c-4aca51f45457 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:00.397353 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8f59bd19-df8c-4e83-bf7c-4aca51f45457 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:00.397812 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8f59bd19-df8c-4e83-bf7c-4aca51f45457 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:00.398238 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8f59bd19-df8c-4e83-bf7c-4aca51f45457 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:00.475605 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-8f59bd19-df8c-4e83-bf7c-4aca51f45457 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:06:00.484224 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-8f59bd19-df8c-4e83-bf7c-4aca51f45457 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e" status: 200 len: 1307 microversion: 2.1 time: 0.109828 Aug 24 08:06:00.484821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 464/925] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:06:00 2022] GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e => generated 1307 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:06:01.504316 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-252bc6e4-b77c-4fb3-bc39-6a6ceb710687 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:06:01.504931 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-252bc6e4-b77c-4fb3-bc39-6a6ceb710687 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:06:01.512043 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-252bc6e4-b77c-4fb3-bc39-6a6ceb710687 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:01.512520 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-252bc6e4-b77c-4fb3-bc39-6a6ceb710687 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:01.512985 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-252bc6e4-b77c-4fb3-bc39-6a6ceb710687 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:01.513676 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-252bc6e4-b77c-4fb3-bc39-6a6ceb710687 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:01.514123 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-252bc6e4-b77c-4fb3-bc39-6a6ceb710687 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:01.514538 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-252bc6e4-b77c-4fb3-bc39-6a6ceb710687 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:01.641442 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-252bc6e4-b77c-4fb3-bc39-6a6ceb710687 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:06:01.649259 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-252bc6e4-b77c-4fb3-bc39-6a6ceb710687 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e" status: 200 len: 1363 microversion: 2.1 time: 0.148840 Aug 24 08:06:01.649836 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 462/926] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:06:01 2022] GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:06:01.932900 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-5ad89dbb-4aba-49da-972b-ca2ebdd0271e req-2edfec32-45ce-40c4-a313-8898a7ae0f0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31e6fb33-c8ea-4e39-a422-c6b07bfb829e", "tag": "f02dabd3-ccfb-4873-a58e-eff78c49bee3"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:06:01.942447 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-5ad89dbb-4aba-49da-972b-ca2ebdd0271e req-2edfec32-45ce-40c4-a313-8898a7ae0f0e service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:01.942855 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-5ad89dbb-4aba-49da-972b-ca2ebdd0271e req-2edfec32-45ce-40c4-a313-8898a7ae0f0e service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:01.943286 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-5ad89dbb-4aba-49da-972b-ca2ebdd0271e req-2edfec32-45ce-40c4-a313-8898a7ae0f0e service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:01.954122 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-5ad89dbb-4aba-49da-972b-ca2ebdd0271e req-2edfec32-45ce-40c4-a313-8898a7ae0f0e service nova] Creating event network-changed:f02dabd3-ccfb-4873-a58e-eff78c49bee3 for instance 31e6fb33-c8ea-4e39-a422-c6b07bfb829e on hv-cinder-85427 Aug 24 08:06:01.959061 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-5ad89dbb-4aba-49da-972b-ca2ebdd0271e req-2edfec32-45ce-40c4-a313-8898a7ae0f0e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030519 Aug 24 08:06:01.959710 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 465/927] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:06:02.669514 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-a322ec79-845b-4ee7-9fab-a7a6f27cb717 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:06:02.670153 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-a322ec79-845b-4ee7-9fab-a7a6f27cb717 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:06:02.676542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a322ec79-845b-4ee7-9fab-a7a6f27cb717 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:02.677039 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a322ec79-845b-4ee7-9fab-a7a6f27cb717 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:02.677477 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a322ec79-845b-4ee7-9fab-a7a6f27cb717 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:02.678168 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a322ec79-845b-4ee7-9fab-a7a6f27cb717 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:02.678624 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a322ec79-845b-4ee7-9fab-a7a6f27cb717 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:02.679047 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a322ec79-845b-4ee7-9fab-a7a6f27cb717 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:02.806738 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-a322ec79-845b-4ee7-9fab-a7a6f27cb717 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:06:02.814526 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-a322ec79-845b-4ee7-9fab-a7a6f27cb717 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e" status: 200 len: 1363 microversion: 2.1 time: 0.148867 Aug 24 08:06:02.815079 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 463/928] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:06:02 2022] GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:06:03.837178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-31a9fd9e-6e89-4a52-b599-c783111525fa tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:06:03.837885 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-31a9fd9e-6e89-4a52-b599-c783111525fa tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:06:03.844020 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-31a9fd9e-6e89-4a52-b599-c783111525fa tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:03.844509 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-31a9fd9e-6e89-4a52-b599-c783111525fa tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:03.844983 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-31a9fd9e-6e89-4a52-b599-c783111525fa tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:03.845680 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-31a9fd9e-6e89-4a52-b599-c783111525fa tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:03.846139 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-31a9fd9e-6e89-4a52-b599-c783111525fa tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:03.846573 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-31a9fd9e-6e89-4a52-b599-c783111525fa tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:03.979626 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-31a9fd9e-6e89-4a52-b599-c783111525fa tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:06:03.987271 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-31a9fd9e-6e89-4a52-b599-c783111525fa tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e" status: 200 len: 1363 microversion: 2.1 time: 0.155435 Aug 24 08:06:03.987830 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 466/929] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:06:03 2022] GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:06:05.007880 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-a65d7810-2c2f-401c-8f20-5c9c2eaaa73a tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:06:05.008495 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-a65d7810-2c2f-401c-8f20-5c9c2eaaa73a tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:06:05.010808 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:05.015509 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a65d7810-2c2f-401c-8f20-5c9c2eaaa73a tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:05.015996 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a65d7810-2c2f-401c-8f20-5c9c2eaaa73a tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:05.016438 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a65d7810-2c2f-401c-8f20-5c9c2eaaa73a tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:05.017162 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a65d7810-2c2f-401c-8f20-5c9c2eaaa73a tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:05.017619 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a65d7810-2c2f-401c-8f20-5c9c2eaaa73a tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:05.018049 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a65d7810-2c2f-401c-8f20-5c9c2eaaa73a tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:05.148015 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-a65d7810-2c2f-401c-8f20-5c9c2eaaa73a tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:06:05.156429 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-a65d7810-2c2f-401c-8f20-5c9c2eaaa73a tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e" status: 200 len: 1363 microversion: 2.1 time: 0.152447 Aug 24 08:06:05.157016 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 464/930] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:06:05 2022] GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:06:06.177852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-8c1a77fa-1bd0-458e-9f98-ffd3cff74e27 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:06:06.178404 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-8c1a77fa-1bd0-458e-9f98-ffd3cff74e27 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:06:06.181567 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:06.186333 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8c1a77fa-1bd0-458e-9f98-ffd3cff74e27 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:06.186850 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8c1a77fa-1bd0-458e-9f98-ffd3cff74e27 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:06.187291 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8c1a77fa-1bd0-458e-9f98-ffd3cff74e27 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:06.188005 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8c1a77fa-1bd0-458e-9f98-ffd3cff74e27 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:06.188466 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8c1a77fa-1bd0-458e-9f98-ffd3cff74e27 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:06.188921 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8c1a77fa-1bd0-458e-9f98-ffd3cff74e27 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:06.193141 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:06.327105 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-8c1a77fa-1bd0-458e-9f98-ffd3cff74e27 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:06:06.335427 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-8c1a77fa-1bd0-458e-9f98-ffd3cff74e27 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e" status: 200 len: 1363 microversion: 2.1 time: 0.161793 Aug 24 08:06:06.335996 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 467/931] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:06:06 2022] GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:06:07.359761 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-9af7abfd-622c-4120-9633-9d92c8045b6a tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:06:07.371596 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-9af7abfd-622c-4120-9633-9d92c8045b6a tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:06:07.371596 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9af7abfd-622c-4120-9633-9d92c8045b6a tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:07.371596 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9af7abfd-622c-4120-9633-9d92c8045b6a tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:07.371596 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9af7abfd-622c-4120-9633-9d92c8045b6a tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:07.372057 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9af7abfd-622c-4120-9633-9d92c8045b6a tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:07.372057 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9af7abfd-622c-4120-9633-9d92c8045b6a tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:07.372057 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9af7abfd-622c-4120-9633-9d92c8045b6a tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:07.372470 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=100 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:07.502351 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9af7abfd-622c-4120-9633-9d92c8045b6a tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:06:07.510697 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-9af7abfd-622c-4120-9633-9d92c8045b6a tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e" status: 200 len: 1363 microversion: 2.1 time: 0.154908 Aug 24 08:06:07.511255 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 465/932] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:06:07 2022] GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:06:07.824197 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-c6601dba-f44e-4be5-8834-8596c571dd35 req-f120a2a4-cad9-4d7e-b605-6cc532b745bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31e6fb33-c8ea-4e39-a422-c6b07bfb829e", "name": "network-vif-plugged", "status": "completed", "tag": "f02dabd3-ccfb-4873-a58e-eff78c49bee3"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:06:07.834140 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-c6601dba-f44e-4be5-8834-8596c571dd35 req-f120a2a4-cad9-4d7e-b605-6cc532b745bd service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:07.834618 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-c6601dba-f44e-4be5-8834-8596c571dd35 req-f120a2a4-cad9-4d7e-b605-6cc532b745bd service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:07.835049 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-c6601dba-f44e-4be5-8834-8596c571dd35 req-f120a2a4-cad9-4d7e-b605-6cc532b745bd service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:07.845909 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-c6601dba-f44e-4be5-8834-8596c571dd35 req-f120a2a4-cad9-4d7e-b605-6cc532b745bd service nova] Creating event network-vif-plugged:f02dabd3-ccfb-4873-a58e-eff78c49bee3 for instance 31e6fb33-c8ea-4e39-a422-c6b07bfb829e on hv-cinder-85427 Aug 24 08:06:07.850581 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-c6601dba-f44e-4be5-8834-8596c571dd35 req-f120a2a4-cad9-4d7e-b605-6cc532b745bd service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030383 Aug 24 08:06:07.851156 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 468/933] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:06:08.531418 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-451a8f3d-9b12-430f-9c3a-d3a5d83b555e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:06:08.532027 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-451a8f3d-9b12-430f-9c3a-d3a5d83b555e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:06:08.533921 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=2 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:08.534605 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=6 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:08.539797 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-451a8f3d-9b12-430f-9c3a-d3a5d83b555e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:08.540279 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-451a8f3d-9b12-430f-9c3a-d3a5d83b555e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:08.540739 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-451a8f3d-9b12-430f-9c3a-d3a5d83b555e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:08.541426 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-451a8f3d-9b12-430f-9c3a-d3a5d83b555e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:08.542155 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-451a8f3d-9b12-430f-9c3a-d3a5d83b555e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:08.542582 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-451a8f3d-9b12-430f-9c3a-d3a5d83b555e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:08.672778 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-451a8f3d-9b12-430f-9c3a-d3a5d83b555e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:06:08.680459 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-451a8f3d-9b12-430f-9c3a-d3a5d83b555e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e" status: 200 len: 1363 microversion: 2.1 time: 0.152928 Aug 24 08:06:08.681052 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 466/934] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:06:08 2022] GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:06:09.699051 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=6 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:09.703571 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-f1300630-cb97-470a-a8f3-d20edf0eec19 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:06:09.704269 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-f1300630-cb97-470a-a8f3-d20edf0eec19 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:06:09.710318 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f1300630-cb97-470a-a8f3-d20edf0eec19 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:09.712541 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f1300630-cb97-470a-a8f3-d20edf0eec19 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:09.712541 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f1300630-cb97-470a-a8f3-d20edf0eec19 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:09.712541 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f1300630-cb97-470a-a8f3-d20edf0eec19 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:09.712541 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f1300630-cb97-470a-a8f3-d20edf0eec19 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:09.712967 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f1300630-cb97-470a-a8f3-d20edf0eec19 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:09.849625 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-f1300630-cb97-470a-a8f3-d20edf0eec19 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:06:09.857674 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-f1300630-cb97-470a-a8f3-d20edf0eec19 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e" status: 200 len: 1363 microversion: 2.1 time: 0.159755 Aug 24 08:06:09.858291 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 469/935] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:06:09 2022] GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:06:10.878702 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-2c8cb042-8004-4393-bd09-0be620a680c0 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:06:10.879296 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-2c8cb042-8004-4393-bd09-0be620a680c0 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:06:10.885788 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2c8cb042-8004-4393-bd09-0be620a680c0 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:10.886270 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2c8cb042-8004-4393-bd09-0be620a680c0 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:10.886760 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2c8cb042-8004-4393-bd09-0be620a680c0 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:10.887450 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2c8cb042-8004-4393-bd09-0be620a680c0 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:10.887908 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2c8cb042-8004-4393-bd09-0be620a680c0 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:10.888454 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-2c8cb042-8004-4393-bd09-0be620a680c0 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:11.014891 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-2c8cb042-8004-4393-bd09-0be620a680c0 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:06:11.022531 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-2c8cb042-8004-4393-bd09-0be620a680c0 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e" status: 200 len: 1548 microversion: 2.1 time: 0.147710 Aug 24 08:06:11.023094 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 467/936] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:06:10 2022] GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:06:11.044284 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-59de289a-050c-42d1-ae1e-a3e1f7f961fa tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:06:11.044855 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-59de289a-050c-42d1-ae1e-a3e1f7f961fa tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:06:11.051431 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-59de289a-050c-42d1-ae1e-a3e1f7f961fa tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:11.051914 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-59de289a-050c-42d1-ae1e-a3e1f7f961fa tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:11.052353 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-59de289a-050c-42d1-ae1e-a3e1f7f961fa tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:11.053084 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-59de289a-050c-42d1-ae1e-a3e1f7f961fa tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:11.053545 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-59de289a-050c-42d1-ae1e-a3e1f7f961fa tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:11.053975 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-59de289a-050c-42d1-ae1e-a3e1f7f961fa tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:11.129678 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-59de289a-050c-42d1-ae1e-a3e1f7f961fa tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090070 Aug 24 08:06:11.130219 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 470/937] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 24 08:06:11 2022] GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:06:12.105035 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-ee9bdf3d-f597-47e9-89ab-dbe865b04788 req-798f06ea-a7bd-4f2c-8daa-8ba4c0464c1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31e6fb33-c8ea-4e39-a422-c6b07bfb829e", "tag": "f02dabd3-ccfb-4873-a58e-eff78c49bee3"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:06:12.114771 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-ee9bdf3d-f597-47e9-89ab-dbe865b04788 req-798f06ea-a7bd-4f2c-8daa-8ba4c0464c1c service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:12.115251 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-ee9bdf3d-f597-47e9-89ab-dbe865b04788 req-798f06ea-a7bd-4f2c-8daa-8ba4c0464c1c service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:12.115687 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-ee9bdf3d-f597-47e9-89ab-dbe865b04788 req-798f06ea-a7bd-4f2c-8daa-8ba4c0464c1c service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:12.127070 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-ee9bdf3d-f597-47e9-89ab-dbe865b04788 req-798f06ea-a7bd-4f2c-8daa-8ba4c0464c1c service nova] Creating event network-changed:f02dabd3-ccfb-4873-a58e-eff78c49bee3 for instance 31e6fb33-c8ea-4e39-a422-c6b07bfb829e on hv-cinder-85427 Aug 24 08:06:12.132446 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-ee9bdf3d-f597-47e9-89ab-dbe865b04788 req-798f06ea-a7bd-4f2c-8daa-8ba4c0464c1c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031005 Aug 24 08:06:12.133535 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 468/938] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:06:46.978065 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=7 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:46.978823 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=17 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:46.982799 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b5029654-fef4-47d2-a58a-cd1107900149 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:06:46.983294 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-b5029654-fef4-47d2-a58a-cd1107900149 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:06:46.989229 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b5029654-fef4-47d2-a58a-cd1107900149 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:46.991833 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b5029654-fef4-47d2-a58a-cd1107900149 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:46.991833 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b5029654-fef4-47d2-a58a-cd1107900149 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:46.991833 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b5029654-fef4-47d2-a58a-cd1107900149 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:46.991833 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b5029654-fef4-47d2-a58a-cd1107900149 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:46.992287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b5029654-fef4-47d2-a58a-cd1107900149 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:47.015870 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-b5029654-fef4-47d2-a58a-cd1107900149 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e/ips" status: 200 len: 145 microversion: 2.1 time: 0.039217 Aug 24 08:06:47.016433 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 471/939] 10.222.0.72 () {58 vars in 1248 bytes} [Wed Aug 24 08:06:46 2022] GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:06:48.560101 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-c1e075fb-169d-4aa7-b881-6d421abf485c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d447882f-0d4c-4220-9489-04d43257bf97"}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:06:48.563062 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-c1e075fb-169d-4aa7-b881-6d421abf485c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:06:48.565352 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=9 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:48.565997 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=19 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:48.570870 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c1e075fb-169d-4aa7-b881-6d421abf485c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:48.571542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c1e075fb-169d-4aa7-b881-6d421abf485c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:48.571987 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c1e075fb-169d-4aa7-b881-6d421abf485c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:48.572709 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c1e075fb-169d-4aa7-b881-6d421abf485c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:48.578884 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c1e075fb-169d-4aa7-b881-6d421abf485c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:48.578884 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c1e075fb-169d-4aa7-b881-6d421abf485c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:49.225169 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-c1e075fb-169d-4aa7-b881-6d421abf485c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "POST /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.668983 Aug 24 08:06:49.225769 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 469/940] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 24 08:06:48 2022] POST /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e/os-volume_attachments => generated 194 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:06:56.742104 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-408584df-2944-459d-8f5e-b35cc88b407e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:06:56.744301 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-408584df-2944-459d-8f5e-b35cc88b407e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:06:56.751407 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-408584df-2944-459d-8f5e-b35cc88b407e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:56.751875 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-408584df-2944-459d-8f5e-b35cc88b407e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:56.752302 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-408584df-2944-459d-8f5e-b35cc88b407e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:56.753011 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-408584df-2944-459d-8f5e-b35cc88b407e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:56.753464 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-408584df-2944-459d-8f5e-b35cc88b407e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:56.753880 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-408584df-2944-459d-8f5e-b35cc88b407e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:56.783140 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-408584df-2944-459d-8f5e-b35cc88b407e tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045009 Aug 24 08:06:56.783683 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 472/941] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 24 08:06:56 2022] GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:06:56.795020 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-e7c9607e-2b45-4bdc-b682-8ec3958a5062 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:06:56.795658 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-e7c9607e-2b45-4bdc-b682-8ec3958a5062 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:06:56.802277 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e7c9607e-2b45-4bdc-b682-8ec3958a5062 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:56.802770 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e7c9607e-2b45-4bdc-b682-8ec3958a5062 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:56.803232 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e7c9607e-2b45-4bdc-b682-8ec3958a5062 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:56.803913 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e7c9607e-2b45-4bdc-b682-8ec3958a5062 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:56.804372 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e7c9607e-2b45-4bdc-b682-8ec3958a5062 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:56.804831 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e7c9607e-2b45-4bdc-b682-8ec3958a5062 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:56.833272 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-e7c9607e-2b45-4bdc-b682-8ec3958a5062 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e/os-volume_attachments/d447882f-0d4c-4220-9489-04d43257bf97" status: 200 len: 194 microversion: 2.1 time: 0.042973 Aug 24 08:06:56.833859 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 470/942] 10.222.0.72 () {58 vars in 1413 bytes} [Wed Aug 24 08:06:56 2022] GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e/os-volume_attachments/d447882f-0d4c-4220-9489-04d43257bf97 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:06:58.390663 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-fe603ef6-2761-4a5a-ab24-9bb5f3e9e9c5 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08c81e17-f0e1-471e-84cc-14a880b58b11"}} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:06:58.393013 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-fe603ef6-2761-4a5a-ab24-9bb5f3e9e9c5 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:06:58.399541 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fe603ef6-2761-4a5a-ab24-9bb5f3e9e9c5 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:58.400286 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fe603ef6-2761-4a5a-ab24-9bb5f3e9e9c5 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:58.400748 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fe603ef6-2761-4a5a-ab24-9bb5f3e9e9c5 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:58.401440 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fe603ef6-2761-4a5a-ab24-9bb5f3e9e9c5 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:06:58.401894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fe603ef6-2761-4a5a-ab24-9bb5f3e9e9c5 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:06:58.402311 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fe603ef6-2761-4a5a-ab24-9bb5f3e9e9c5 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:06:59.119932 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-fe603ef6-2761-4a5a-ab24-9bb5f3e9e9c5 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "POST /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.733023 Aug 24 08:06:59.120543 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 473/943] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 24 08:06:58 2022] POST /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e/os-volume_attachments => generated 194 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:07:06.656987 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-a1eb2362-7463-4a28-a6e4-0e1b45d0b810 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:06.659074 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-a1eb2362-7463-4a28-a6e4-0e1b45d0b810 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:06.666314 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a1eb2362-7463-4a28-a6e4-0e1b45d0b810 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:06.666786 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a1eb2362-7463-4a28-a6e4-0e1b45d0b810 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:06.667214 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a1eb2362-7463-4a28-a6e4-0e1b45d0b810 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:06.667901 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a1eb2362-7463-4a28-a6e4-0e1b45d0b810 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:06.668351 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a1eb2362-7463-4a28-a6e4-0e1b45d0b810 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:06.668794 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-a1eb2362-7463-4a28-a6e4-0e1b45d0b810 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:06.697945 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-a1eb2362-7463-4a28-a6e4-0e1b45d0b810 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045023 Aug 24 08:07:06.698497 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 471/944] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 24 08:07:06 2022] GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:07:06.844037 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-9aa355fb-2189-49a4-bd27-500ad78b4ff6 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:06.844623 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-9aa355fb-2189-49a4-bd27-500ad78b4ff6 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:06.851052 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9aa355fb-2189-49a4-bd27-500ad78b4ff6 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:06.851542 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9aa355fb-2189-49a4-bd27-500ad78b4ff6 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:06.851985 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9aa355fb-2189-49a4-bd27-500ad78b4ff6 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:06.852713 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9aa355fb-2189-49a4-bd27-500ad78b4ff6 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:06.853178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9aa355fb-2189-49a4-bd27-500ad78b4ff6 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:06.853607 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9aa355fb-2189-49a4-bd27-500ad78b4ff6 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:06.884209 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-9aa355fb-2189-49a4-bd27-500ad78b4ff6 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e/os-volume_attachments/d447882f-0d4c-4220-9489-04d43257bf97" status: 200 len: 194 microversion: 2.1 time: 0.045014 Aug 24 08:07:06.884829 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 474/945] 10.222.0.72 () {58 vars in 1413 bytes} [Wed Aug 24 08:07:06 2022] GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e/os-volume_attachments/d447882f-0d4c-4220-9489-04d43257bf97 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:07:06.895000 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-9e50b50c-3fad-408d-ae7e-f1f9fe7a5575 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:06.895485 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-9e50b50c-3fad-408d-ae7e-f1f9fe7a5575 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:06.902309 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e50b50c-3fad-408d-ae7e-f1f9fe7a5575 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:06.902815 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e50b50c-3fad-408d-ae7e-f1f9fe7a5575 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:06.903252 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e50b50c-3fad-408d-ae7e-f1f9fe7a5575 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:06.903929 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e50b50c-3fad-408d-ae7e-f1f9fe7a5575 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:06.904376 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e50b50c-3fad-408d-ae7e-f1f9fe7a5575 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:06.904826 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e50b50c-3fad-408d-ae7e-f1f9fe7a5575 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:06.983780 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.objects.instance [None req-9e50b50c-3fad-408d-ae7e-f1f9fe7a5575 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lazy-loading 'services' on Instance uuid 31e6fb33-c8ea-4e39-a422-c6b07bfb829e {{(pid=127590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:07:07.139823 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-9e50b50c-3fad-408d-ae7e-f1f9fe7a5575 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "DELETE /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e/os-volume_attachments/d447882f-0d4c-4220-9489-04d43257bf97" status: 202 len: 0 microversion: 2.1 time: 0.248572 Aug 24 08:07:07.140420 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 472/946] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 24 08:07:06 2022] DELETE /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e/os-volume_attachments/d447882f-0d4c-4220-9489-04d43257bf97 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:07:08.282352 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-fc03f755-0506-40f0-abf1-6b4b2f4eaaa2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:08.282935 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-fc03f755-0506-40f0-abf1-6b4b2f4eaaa2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:08.290189 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fc03f755-0506-40f0-abf1-6b4b2f4eaaa2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:08.290680 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fc03f755-0506-40f0-abf1-6b4b2f4eaaa2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:08.291124 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fc03f755-0506-40f0-abf1-6b4b2f4eaaa2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:08.291834 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fc03f755-0506-40f0-abf1-6b4b2f4eaaa2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:08.292301 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fc03f755-0506-40f0-abf1-6b4b2f4eaaa2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:08.292749 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fc03f755-0506-40f0-abf1-6b4b2f4eaaa2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:08.322426 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-fc03f755-0506-40f0-abf1-6b4b2f4eaaa2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e/os-volume_attachments/08c81e17-f0e1-471e-84cc-14a880b58b11" status: 200 len: 194 microversion: 2.1 time: 0.046068 Aug 24 08:07:08.323029 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 475/947] 10.222.0.72 () {58 vars in 1413 bytes} [Wed Aug 24 08:07:08 2022] GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e/os-volume_attachments/08c81e17-f0e1-471e-84cc-14a880b58b11 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:07:08.335046 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-e679d98d-c6a6-480b-9156-3263df07f599 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:08.335712 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-e679d98d-c6a6-480b-9156-3263df07f599 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:08.341714 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e679d98d-c6a6-480b-9156-3263df07f599 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:08.342189 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e679d98d-c6a6-480b-9156-3263df07f599 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:08.342617 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e679d98d-c6a6-480b-9156-3263df07f599 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:08.343304 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e679d98d-c6a6-480b-9156-3263df07f599 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:08.343754 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e679d98d-c6a6-480b-9156-3263df07f599 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:08.344260 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e679d98d-c6a6-480b-9156-3263df07f599 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:08.426561 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.objects.instance [None req-e679d98d-c6a6-480b-9156-3263df07f599 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lazy-loading 'services' on Instance uuid 31e6fb33-c8ea-4e39-a422-c6b07bfb829e {{(pid=127590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:07:08.653337 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-e679d98d-c6a6-480b-9156-3263df07f599 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "DELETE /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e/os-volume_attachments/08c81e17-f0e1-471e-84cc-14a880b58b11" status: 202 len: 0 microversion: 2.1 time: 0.323402 Aug 24 08:07:08.653931 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 473/948] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 24 08:07:08 2022] DELETE /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e/os-volume_attachments/08c81e17-f0e1-471e-84cc-14a880b58b11 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:07:09.824353 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-7e0bcb9f-2b50-45c9-beb2-f89065a3447b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:09.826645 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-7e0bcb9f-2b50-45c9-beb2-f89065a3447b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:09.833120 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7e0bcb9f-2b50-45c9-beb2-f89065a3447b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:09.833609 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7e0bcb9f-2b50-45c9-beb2-f89065a3447b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:09.834054 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7e0bcb9f-2b50-45c9-beb2-f89065a3447b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:09.834752 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7e0bcb9f-2b50-45c9-beb2-f89065a3447b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:09.835208 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7e0bcb9f-2b50-45c9-beb2-f89065a3447b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:09.835634 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-7e0bcb9f-2b50-45c9-beb2-f89065a3447b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:09.865643 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-7e0bcb9f-2b50-45c9-beb2-f89065a3447b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045685 Aug 24 08:07:09.866221 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 476/949] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 24 08:07:09 2022] GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 08:07:09.977500 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-99d46e9e-2dac-4e9c-991b-5248463e57be tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:09.979814 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-99d46e9e-2dac-4e9c-991b-5248463e57be tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:09.986727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-99d46e9e-2dac-4e9c-991b-5248463e57be tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:09.987213 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-99d46e9e-2dac-4e9c-991b-5248463e57be tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:09.987681 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-99d46e9e-2dac-4e9c-991b-5248463e57be tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:09.988379 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-99d46e9e-2dac-4e9c-991b-5248463e57be tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:09.988877 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-99d46e9e-2dac-4e9c-991b-5248463e57be tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:09.989308 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-99d46e9e-2dac-4e9c-991b-5248463e57be tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:10.017528 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-99d46e9e-2dac-4e9c-991b-5248463e57be tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044987 Aug 24 08:07:10.018066 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 474/950] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 24 08:07:09 2022] GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 08:07:10.078097 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-62601c8b-5c97-40b1-95f9-0649a8a5aa13 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:10.078600 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-62601c8b-5c97-40b1-95f9-0649a8a5aa13 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:10.084479 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-62601c8b-5c97-40b1-95f9-0649a8a5aa13 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:10.085001 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-62601c8b-5c97-40b1-95f9-0649a8a5aa13 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:10.085446 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-62601c8b-5c97-40b1-95f9-0649a8a5aa13 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:10.086153 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-62601c8b-5c97-40b1-95f9-0649a8a5aa13 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:10.087194 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-62601c8b-5c97-40b1-95f9-0649a8a5aa13 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:10.087631 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-62601c8b-5c97-40b1-95f9-0649a8a5aa13 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:10.111658 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-62601c8b-5c97-40b1-95f9-0649a8a5aa13 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Going to try to terminate instance {{(pid=127589) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:07:10.418894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-62601c8b-5c97-40b1-95f9-0649a8a5aa13 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "DELETE /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e" status: 204 len: 0 microversion: 2.1 time: 0.344350 Aug 24 08:07:10.419489 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 477/951] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 24 08:07:10 2022] DELETE /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:07:10.427685 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-ebd74652-3f79-4146-a6d7-82c3256378e2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:10.432022 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-ebd74652-3f79-4146-a6d7-82c3256378e2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:10.434472 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ebd74652-3f79-4146-a6d7-82c3256378e2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:10.434958 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ebd74652-3f79-4146-a6d7-82c3256378e2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:10.435396 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ebd74652-3f79-4146-a6d7-82c3256378e2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:10.436090 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ebd74652-3f79-4146-a6d7-82c3256378e2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:10.436573 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ebd74652-3f79-4146-a6d7-82c3256378e2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:10.437035 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ebd74652-3f79-4146-a6d7-82c3256378e2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:10.575139 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-ebd74652-3f79-4146-a6d7-82c3256378e2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:10.582966 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-ebd74652-3f79-4146-a6d7-82c3256378e2 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e" status: 200 len: 1673 microversion: 2.1 time: 0.159259 Aug 24 08:07:10.583549 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 475/952] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:10 2022] GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:07:11.605389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-dcad6af9-076f-4a3b-aa40-db00bb5dccc3 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:11.606079 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-dcad6af9-076f-4a3b-aa40-db00bb5dccc3 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:11.612561 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-dcad6af9-076f-4a3b-aa40-db00bb5dccc3 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:11.613071 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-dcad6af9-076f-4a3b-aa40-db00bb5dccc3 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:11.613506 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-dcad6af9-076f-4a3b-aa40-db00bb5dccc3 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:11.614192 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-dcad6af9-076f-4a3b-aa40-db00bb5dccc3 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:11.614641 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-dcad6af9-076f-4a3b-aa40-db00bb5dccc3 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:11.615062 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-dcad6af9-076f-4a3b-aa40-db00bb5dccc3 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:11.741863 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-dcad6af9-076f-4a3b-aa40-db00bb5dccc3 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:11.750262 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-dcad6af9-076f-4a3b-aa40-db00bb5dccc3 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e" status: 200 len: 1673 microversion: 2.1 time: 0.149211 Aug 24 08:07:11.750827 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 478/953] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:11 2022] GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:07:12.772426 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-25c82505-07a0-45d0-be8c-cb28192c565b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:12.773036 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-25c82505-07a0-45d0-be8c-cb28192c565b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:12.780324 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-25c82505-07a0-45d0-be8c-cb28192c565b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:12.780834 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-25c82505-07a0-45d0-be8c-cb28192c565b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:12.781270 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-25c82505-07a0-45d0-be8c-cb28192c565b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:12.781957 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-25c82505-07a0-45d0-be8c-cb28192c565b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:12.782412 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-25c82505-07a0-45d0-be8c-cb28192c565b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:12.782833 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-25c82505-07a0-45d0-be8c-cb28192c565b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:12.848372 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-25c82505-07a0-45d0-be8c-cb28192c565b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:12.856588 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-25c82505-07a0-45d0-be8c-cb28192c565b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e" status: 200 len: 1605 microversion: 2.1 time: 0.088113 Aug 24 08:07:12.857301 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 476/954] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:12 2022] GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e => generated 1605 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:07:13.202980 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-ce75be36-3b9d-43bf-9d02-6a8d6113ea96 req-5db930b2-cd6c-43ae-8f13-2b722afa0656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31e6fb33-c8ea-4e39-a422-c6b07bfb829e", "name": "network-vif-deleted", "tag": "f02dabd3-ccfb-4873-a58e-eff78c49bee3"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:07:13.215114 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-ce75be36-3b9d-43bf-9d02-6a8d6113ea96 req-5db930b2-cd6c-43ae-8f13-2b722afa0656 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:13.215753 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-ce75be36-3b9d-43bf-9d02-6a8d6113ea96 req-5db930b2-cd6c-43ae-8f13-2b722afa0656 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:13.216217 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-ce75be36-3b9d-43bf-9d02-6a8d6113ea96 req-5db930b2-cd6c-43ae-8f13-2b722afa0656 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:13.232983 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-ce75be36-3b9d-43bf-9d02-6a8d6113ea96 req-5db930b2-cd6c-43ae-8f13-2b722afa0656 service nova] Creating event network-vif-deleted:f02dabd3-ccfb-4873-a58e-eff78c49bee3 for instance 31e6fb33-c8ea-4e39-a422-c6b07bfb829e on hv-cinder-85427 Aug 24 08:07:13.239253 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-ce75be36-3b9d-43bf-9d02-6a8d6113ea96 req-5db930b2-cd6c-43ae-8f13-2b722afa0656 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103151 Aug 24 08:07:13.240561 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 479/955] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:07:13.879845 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-7708cb35-0260-4751-a04e-a9f19a2c1cd1 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:13.880512 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-7708cb35-0260-4751-a04e-a9f19a2c1cd1 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:13.888614 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7708cb35-0260-4751-a04e-a9f19a2c1cd1 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:13.889147 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7708cb35-0260-4751-a04e-a9f19a2c1cd1 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:13.889587 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7708cb35-0260-4751-a04e-a9f19a2c1cd1 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:13.890338 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7708cb35-0260-4751-a04e-a9f19a2c1cd1 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:13.890807 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7708cb35-0260-4751-a04e-a9f19a2c1cd1 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:13.891236 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7708cb35-0260-4751-a04e-a9f19a2c1cd1 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:13.927840 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7708cb35-0260-4751-a04e-a9f19a2c1cd1 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:13.928043 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7708cb35-0260-4751-a04e-a9f19a2c1cd1 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:13.928684 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7708cb35-0260-4751-a04e-a9f19a2c1cd1 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:13.933369 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.objects.instance [None req-7708cb35-0260-4751-a04e-a9f19a2c1cd1 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lazy-loading 'fault' on Instance uuid 31e6fb33-c8ea-4e39-a422-c6b07bfb829e {{(pid=127590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:07:13.986461 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-7708cb35-0260-4751-a04e-a9f19a2c1cd1 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a590d584ed654ca399875a5e04a57a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef79c9df5a2541afaeff1a82b3e4a496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:13.995017 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-7708cb35-0260-4751-a04e-a9f19a2c1cd1 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e" status: 200 len: 1327 microversion: 2.1 time: 0.119278 Aug 24 08:07:13.995591 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 477/956] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:13 2022] GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e => generated 1327 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:07:15.022013 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-514fb04e-b514-4565-8597-f4677d30675d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:15.022722 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-514fb04e-b514-4565-8597-f4677d30675d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:15.030245 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-514fb04e-b514-4565-8597-f4677d30675d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:15.030764 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-514fb04e-b514-4565-8597-f4677d30675d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:15.031207 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-514fb04e-b514-4565-8597-f4677d30675d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:15.031908 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-514fb04e-b514-4565-8597-f4677d30675d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:15.032367 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-514fb04e-b514-4565-8597-f4677d30675d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:15.032833 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-514fb04e-b514-4565-8597-f4677d30675d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:15.046104 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-514fb04e-b514-4565-8597-f4677d30675d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] HTTP exception thrown: Instance 31e6fb33-c8ea-4e39-a422-c6b07bfb829e could not be found. Aug 24 08:07:15.047747 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-514fb04e-b514-4565-8597-f4677d30675d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Request method failure captured: Aug 24 08:07:15.047747 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e HTTP/1.1 Aug 24 08:07:15.047747 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 08:07:15.047747 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 08:07:15.047747 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 08:07:15.047747 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 08:07:15.047747 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 08:07:15.047747 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 08:07:15.047747 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 08:07:15.047747 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 08:07:15.047747 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdtB8wg4xoATMZUNjy9gDWlG957s7r1lTlMyaQau4EdGEqi-F0s8v1oVa0_NdU26sHO4_YgFT0_VInMP9OLpHuqoP64dfsEuBEPzjsDqYspXwBR-NmoFPBnV18jLOmhWzTuIdL7GDg4xSQXFZKLeBOO3ckV29yKRXUxhmEN99EpbE2A Aug 24 08:07:15.047747 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 08:07:15.047747 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 08:07:15.047747 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 08:07:15.047747 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 08:07:15.047747 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 08:07:15.047747 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 08:07:15.047747 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: ef79c9df5a2541afaeff1a82b3e4a496 Aug 24 08:07:15.047747 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-AttachVolumeTestJSON-2104148936 Aug 24 08:07:15.047747 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 08:07:15.047747 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 08:07:15.049495 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ef79c9df5a2541afaeff1a82b3e4a496"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ef79c9df5a2541afaeff1a82b3e4a496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ef79c9df5a2541afaeff1a82b3e4a496"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ef79c9df5a2541afaeff1a82b3e4a496"}]}] Aug 24 08:07:15.049495 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-AttachVolumeTestJSON-2104148936 Aug 24 08:07:15.049495 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: ef79c9df5a2541afaeff1a82b3e4a496 Aug 24 08:07:15.049495 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2104148936 Aug 24 08:07:15.049495 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-AttachVolumeTestJSON-2104148936-project Aug 24 08:07:15.049495 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 08:07:15.049495 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 08:07:15.049495 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: a590d584ed654ca399875a5e04a57a24 Aug 24 08:07:15.049495 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-AttachVolumeTestJSON-2104148936-project Aug 24 08:07:15.049495 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 08:07:15.049495 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Instance 31e6fb33-c8ea-4e39-a422-c6b07bfb829e could not be found. Aug 24 08:07:15.049495 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': '31e6fb33-c8ea-4e39-a422-c6b07bfb829e'} Aug 24 08:07:15.050550 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:07:15.050550 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:07:15.050550 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:07:15.050550 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:07:15.050550 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:07:15.050550 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:07:15.050550 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:07:15.050550 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:07:15.050550 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:07:15.050550 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:07:15.050550 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31e6fb33-c8ea-4e39-a422-c6b07bfb829e could not be found. Aug 24 08:07:15.050550 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:07:15.050550 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:07:15.050550 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:07:15.050550 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:07:15.050550 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:07:15.050550 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:07:15.050550 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:07:15.050550 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:07:15.050550 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:07:15.052154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:07:15.052154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:07:15.052154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:07:15.052154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:07:15.052154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:07:15.052154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:07:15.052154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:07:15.052154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31e6fb33-c8ea-4e39-a422-c6b07bfb829e could not be found. Aug 24 08:07:15.052154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:07:15.052154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:07:15.052154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:07:15.052154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:07:15.052154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:07:15.052154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:07:15.052154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:07:15.052154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:07:15.052154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31e6fb33-c8ea-4e39-a422-c6b07bfb829e could not be found. Aug 24 08:07:15.052154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:07:15.053614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-514fb04e-b514-4565-8597-f4677d30675d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Returning 404 to user: Instance 31e6fb33-c8ea-4e39-a422-c6b07bfb829e could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:07:15.053614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-514fb04e-b514-4565-8597-f4677d30675d tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e" status: 404 len: 111 microversion: 2.1 time: 0.031424 Aug 24 08:07:15.053614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 480/957] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:15 2022] GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:07:15.058953 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-69354017-e876-4ac5-aaa6-2e3500340ae7 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '.version_select at 0x7f320c615d30>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:15.134727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-69354017-e876-4ac5-aaa6-2e3500340ae7 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-460613901" status: 202 len: 0 microversion: 2.1 time: 0.079500 Aug 24 08:07:15.135305 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 478/958] 10.222.0.72 () {58 vars in 1218 bytes} [Wed Aug 24 08:07:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-460613901 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:07:20.548700 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e19d2041-4798-42cd-aef2-fbe5748713ac tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:20.551993 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-e19d2041-4798-42cd-aef2-fbe5748713ac tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:20.552186 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:20.557167 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e19d2041-4798-42cd-aef2-fbe5748713ac tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:20.557593 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e19d2041-4798-42cd-aef2-fbe5748713ac tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:20.558029 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e19d2041-4798-42cd-aef2-fbe5748713ac tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:20.558713 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e19d2041-4798-42cd-aef2-fbe5748713ac tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:20.559254 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e19d2041-4798-42cd-aef2-fbe5748713ac tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:20.560342 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e19d2041-4798-42cd-aef2-fbe5748713ac tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:20.573554 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-e19d2041-4798-42cd-aef2-fbe5748713ac tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] HTTP exception thrown: Instance 31e6fb33-c8ea-4e39-a422-c6b07bfb829e could not be found. Aug 24 08:07:20.575269 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e19d2041-4798-42cd-aef2-fbe5748713ac tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Request method failure captured: Aug 24 08:07:20.575269 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: DELETE /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e HTTP/1.1 Aug 24 08:07:20.575269 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 08:07:20.575269 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 08:07:20.575269 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 08:07:20.575269 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 08:07:20.575269 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 08:07:20.575269 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 08:07:20.575269 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 08:07:20.575269 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 08:07:20.575269 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdtB8wg4xoATMZUNjy9gDWlG957s7r1lTlMyaQau4EdGEqi-F0s8v1oVa0_NdU26sHO4_YgFT0_VInMP9OLpHuqoP64dfsEuBEPzjsDqYspXwBR-NmoFPBnV18jLOmhWzTuIdL7GDg4xSQXFZKLeBOO3ckV29yKRXUxhmEN99EpbE2A Aug 24 08:07:20.575269 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 08:07:20.575269 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 08:07:20.575269 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 08:07:20.575269 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 08:07:20.575269 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 08:07:20.575269 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 08:07:20.575269 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: ef79c9df5a2541afaeff1a82b3e4a496 Aug 24 08:07:20.575269 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-AttachVolumeTestJSON-2104148936 Aug 24 08:07:20.575269 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 08:07:20.575269 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 08:07:20.582661 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ef79c9df5a2541afaeff1a82b3e4a496"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ef79c9df5a2541afaeff1a82b3e4a496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ef79c9df5a2541afaeff1a82b3e4a496"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ef79c9df5a2541afaeff1a82b3e4a496"}]}] Aug 24 08:07:20.582661 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-AttachVolumeTestJSON-2104148936 Aug 24 08:07:20.582661 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: ef79c9df5a2541afaeff1a82b3e4a496 Aug 24 08:07:20.582661 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2104148936 Aug 24 08:07:20.582661 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-AttachVolumeTestJSON-2104148936-project Aug 24 08:07:20.582661 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 08:07:20.582661 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 08:07:20.582661 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: a590d584ed654ca399875a5e04a57a24 Aug 24 08:07:20.582661 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-AttachVolumeTestJSON-2104148936-project Aug 24 08:07:20.582661 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 08:07:20.582661 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Instance 31e6fb33-c8ea-4e39-a422-c6b07bfb829e could not be found. Aug 24 08:07:20.582661 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': '31e6fb33-c8ea-4e39-a422-c6b07bfb829e'} Aug 24 08:07:20.584178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:07:20.584178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:07:20.584178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:07:20.584178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:07:20.584178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:07:20.584178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:07:20.584178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:07:20.584178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:07:20.584178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:07:20.584178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:07:20.584178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31e6fb33-c8ea-4e39-a422-c6b07bfb829e could not be found. Aug 24 08:07:20.584178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:07:20.584178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:07:20.584178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:07:20.584178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:07:20.584178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:07:20.584178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:07:20.584178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:07:20.584178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:07:20.584178 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:07:20.588220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:07:20.588220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 08:07:20.588220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 08:07:20.588220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 08:07:20.588220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 08:07:20.588220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:07:20.588220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:07:20.588220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:07:20.588220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:07:20.588220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31e6fb33-c8ea-4e39-a422-c6b07bfb829e could not be found. Aug 24 08:07:20.588220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:07:20.588220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:07:20.588220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:07:20.588220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:07:20.588220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:07:20.588220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:07:20.588220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:07:20.588220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:07:20.588220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31e6fb33-c8ea-4e39-a422-c6b07bfb829e could not be found. Aug 24 08:07:20.588220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:07:20.592504 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e19d2041-4798-42cd-aef2-fbe5748713ac tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Returning 404 to user: Instance 31e6fb33-c8ea-4e39-a422-c6b07bfb829e could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:07:20.592504 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-e19d2041-4798-42cd-aef2-fbe5748713ac tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "DELETE /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e" status: 404 len: 111 microversion: 2.1 time: 0.033041 Aug 24 08:07:20.592504 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 481/959] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 24 08:07:20 2022] DELETE /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:07:20.593196 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-6b7bcbdb-3670-4556-a9fa-b5347bb70d87 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:20.593196 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-6b7bcbdb-3670-4556-a9fa-b5347bb70d87 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 31e6fb33-c8ea-4e39-a422-c6b07bfb829e] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:20.593196 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:20.595350 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6b7bcbdb-3670-4556-a9fa-b5347bb70d87 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:20.595834 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6b7bcbdb-3670-4556-a9fa-b5347bb70d87 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:20.596265 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6b7bcbdb-3670-4556-a9fa-b5347bb70d87 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:20.597007 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6b7bcbdb-3670-4556-a9fa-b5347bb70d87 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:20.597466 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6b7bcbdb-3670-4556-a9fa-b5347bb70d87 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:20.597900 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6b7bcbdb-3670-4556-a9fa-b5347bb70d87 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:20.601320 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:20.613790 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.wsgi [None req-6b7bcbdb-3670-4556-a9fa-b5347bb70d87 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] HTTP exception thrown: Instance 31e6fb33-c8ea-4e39-a422-c6b07bfb829e could not be found. Aug 24 08:07:20.615443 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-6b7bcbdb-3670-4556-a9fa-b5347bb70d87 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Request method failure captured: Aug 24 08:07:20.615443 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: request: GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e HTTP/1.1 Aug 24 08:07:20.615443 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept: application/json Aug 24 08:07:20.615443 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept-Encoding: identity Aug 24 08:07:20.615443 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Connection: close Aug 24 08:07:20.615443 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Length: 0 Aug 24 08:07:20.615443 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Type: application/json Aug 24 08:07:20.615443 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Host: 10.222.0.72 Aug 24 08:07:20.615443 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Openstack-System-Scope: None Aug 24 08:07:20.615443 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: User-Agent: python-urllib3/1.26.11 Aug 24 08:07:20.615443 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Auth-Token: gAAAAABjBdtB8wg4xoATMZUNjy9gDWlG957s7r1lTlMyaQau4EdGEqi-F0s8v1oVa0_NdU26sHO4_YgFT0_VInMP9OLpHuqoP64dfsEuBEPzjsDqYspXwBR-NmoFPBnV18jLOmhWzTuIdL7GDg4xSQXFZKLeBOO3ckV29yKRXUxhmEN99EpbE2A Aug 24 08:07:20.615443 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Id: None Aug 24 08:07:20.615443 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Name: None Aug 24 08:07:20.615443 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Identity-Status: Confirmed Aug 24 08:07:20.615443 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Is-Admin-Project: True Aug 24 08:07:20.615443 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Id: default Aug 24 08:07:20.615443 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Name: Default Aug 24 08:07:20.615443 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Id: ef79c9df5a2541afaeff1a82b3e4a496 Aug 24 08:07:20.615443 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Name: tempest-AttachVolumeTestJSON-2104148936 Aug 24 08:07:20.615443 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Role: reader,member Aug 24 08:07:20.615443 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Roles: reader,member Aug 24 08:07:20.617100 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ef79c9df5a2541afaeff1a82b3e4a496"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ef79c9df5a2541afaeff1a82b3e4a496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ef79c9df5a2541afaeff1a82b3e4a496"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ef79c9df5a2541afaeff1a82b3e4a496"}]}] Aug 24 08:07:20.617100 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant: tempest-AttachVolumeTestJSON-2104148936 Aug 24 08:07:20.617100 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Id: ef79c9df5a2541afaeff1a82b3e4a496 Aug 24 08:07:20.617100 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2104148936 Aug 24 08:07:20.617100 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User: tempest-AttachVolumeTestJSON-2104148936-project Aug 24 08:07:20.617100 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Id: default Aug 24 08:07:20.617100 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Name: Default Aug 24 08:07:20.617100 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Id: a590d584ed654ca399875a5e04a57a24 Aug 24 08:07:20.617100 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Name: tempest-AttachVolumeTestJSON-2104148936-project Aug 24 08:07:20.617100 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: method: > Aug 24 08:07:20.617100 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: exception: Instance 31e6fb33-c8ea-4e39-a422-c6b07bfb829e could not be found. Aug 24 08:07:20.617100 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: action_args: {'id': '31e6fb33-c8ea-4e39-a422-c6b07bfb829e'} Aug 24 08:07:20.618005 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:07:20.618005 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:07:20.618005 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:07:20.618005 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:07:20.618005 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:07:20.618005 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:07:20.618005 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:07:20.618005 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:07:20.618005 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:07:20.618005 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:07:20.618005 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31e6fb33-c8ea-4e39-a422-c6b07bfb829e could not be found. Aug 24 08:07:20.618005 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:07:20.618005 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:07:20.618005 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:07:20.618005 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:07:20.618005 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:07:20.618005 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:07:20.618005 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:07:20.618005 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:07:20.618005 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:07:20.619501 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:07:20.619501 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:07:20.619501 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:07:20.619501 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:07:20.619501 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:07:20.619501 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:07:20.619501 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:07:20.619501 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31e6fb33-c8ea-4e39-a422-c6b07bfb829e could not be found. Aug 24 08:07:20.619501 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:07:20.619501 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:07:20.619501 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:07:20.619501 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:07:20.619501 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:07:20.619501 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:07:20.619501 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:07:20.619501 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:07:20.619501 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31e6fb33-c8ea-4e39-a422-c6b07bfb829e could not be found. Aug 24 08:07:20.619501 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:07:20.620885 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-6b7bcbdb-3670-4556-a9fa-b5347bb70d87 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Returning 404 to user: Instance 31e6fb33-c8ea-4e39-a422-c6b07bfb829e could not be found. {{(pid=127590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:07:20.620885 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-6b7bcbdb-3670-4556-a9fa-b5347bb70d87 tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e" status: 404 len: 111 microversion: 2.1 time: 0.034685 Aug 24 08:07:20.620885 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 479/960] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:20 2022] GET /compute/v2.1/servers/31e6fb33-c8ea-4e39-a422-c6b07bfb829e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:07:23.104260 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-485c34c8-37d4-4432-a216-953c0396de7b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:23.104870 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-485c34c8-37d4-4432-a216-953c0396de7b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:23.112303 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-485c34c8-37d4-4432-a216-953c0396de7b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:23.112810 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-485c34c8-37d4-4432-a216-953c0396de7b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:23.113248 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-485c34c8-37d4-4432-a216-953c0396de7b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:23.113933 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-485c34c8-37d4-4432-a216-953c0396de7b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:23.114383 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-485c34c8-37d4-4432-a216-953c0396de7b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:23.114802 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-485c34c8-37d4-4432-a216-953c0396de7b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:23.128041 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-485c34c8-37d4-4432-a216-953c0396de7b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] HTTP exception thrown: Instance 840d9152-ac7c-4205-b159-d6151037a3be could not be found. Aug 24 08:07:23.174416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-485c34c8-37d4-4432-a216-953c0396de7b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Request method failure captured: Aug 24 08:07:23.174416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: DELETE /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be HTTP/1.1 Aug 24 08:07:23.174416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 08:07:23.174416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 08:07:23.174416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 08:07:23.174416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 08:07:23.174416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 08:07:23.174416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 08:07:23.174416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 08:07:23.174416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 08:07:23.174416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdtB8wg4xoATMZUNjy9gDWlG957s7r1lTlMyaQau4EdGEqi-F0s8v1oVa0_NdU26sHO4_YgFT0_VInMP9OLpHuqoP64dfsEuBEPzjsDqYspXwBR-NmoFPBnV18jLOmhWzTuIdL7GDg4xSQXFZKLeBOO3ckV29yKRXUxhmEN99EpbE2A Aug 24 08:07:23.174416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 08:07:23.174416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 08:07:23.174416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 08:07:23.174416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 08:07:23.174416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 08:07:23.174416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 08:07:23.174416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: ef79c9df5a2541afaeff1a82b3e4a496 Aug 24 08:07:23.174416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-AttachVolumeTestJSON-2104148936 Aug 24 08:07:23.174416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 08:07:23.174416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 08:07:23.176116 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ef79c9df5a2541afaeff1a82b3e4a496"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ef79c9df5a2541afaeff1a82b3e4a496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ef79c9df5a2541afaeff1a82b3e4a496"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ef79c9df5a2541afaeff1a82b3e4a496"}]}] Aug 24 08:07:23.176116 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-AttachVolumeTestJSON-2104148936 Aug 24 08:07:23.176116 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: ef79c9df5a2541afaeff1a82b3e4a496 Aug 24 08:07:23.176116 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2104148936 Aug 24 08:07:23.176116 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-AttachVolumeTestJSON-2104148936-project Aug 24 08:07:23.176116 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 08:07:23.176116 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 08:07:23.176116 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: a590d584ed654ca399875a5e04a57a24 Aug 24 08:07:23.176116 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-AttachVolumeTestJSON-2104148936-project Aug 24 08:07:23.176116 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 08:07:23.176116 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Instance 840d9152-ac7c-4205-b159-d6151037a3be could not be found. Aug 24 08:07:23.176116 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': '840d9152-ac7c-4205-b159-d6151037a3be'} Aug 24 08:07:23.177047 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:07:23.177047 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:07:23.177047 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:07:23.177047 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:07:23.177047 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:07:23.177047 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:07:23.177047 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:07:23.177047 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:07:23.177047 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:07:23.177047 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:07:23.177047 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 840d9152-ac7c-4205-b159-d6151037a3be could not be found. Aug 24 08:07:23.177047 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:07:23.177047 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:07:23.177047 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:07:23.177047 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:07:23.177047 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:07:23.177047 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:07:23.177047 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:07:23.177047 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:07:23.177047 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:07:23.178575 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:07:23.178575 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 08:07:23.178575 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 08:07:23.178575 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 08:07:23.178575 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 08:07:23.178575 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:07:23.178575 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:07:23.178575 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:07:23.178575 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:07:23.178575 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 840d9152-ac7c-4205-b159-d6151037a3be could not be found. Aug 24 08:07:23.178575 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:07:23.178575 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:07:23.178575 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:07:23.178575 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:07:23.178575 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:07:23.178575 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:07:23.178575 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:07:23.178575 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:07:23.178575 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 840d9152-ac7c-4205-b159-d6151037a3be could not be found. Aug 24 08:07:23.178575 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:07:23.180154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-485c34c8-37d4-4432-a216-953c0396de7b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Returning 404 to user: Instance 840d9152-ac7c-4205-b159-d6151037a3be could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:07:23.180154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-485c34c8-37d4-4432-a216-953c0396de7b tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "DELETE /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 404 len: 111 microversion: 2.1 time: 0.031108 Aug 24 08:07:23.180154 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 482/961] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 24 08:07:23 2022] DELETE /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:07:23.184524 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-ed061ad0-ed32-4d23-93d6-b5b076f3832c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:23.185166 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-ed061ad0-ed32-4d23-93d6-b5b076f3832c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] [instance: 840d9152-ac7c-4205-b159-d6151037a3be] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:23.192731 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ed061ad0-ed32-4d23-93d6-b5b076f3832c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:23.193212 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ed061ad0-ed32-4d23-93d6-b5b076f3832c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:23.193645 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ed061ad0-ed32-4d23-93d6-b5b076f3832c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:23.194338 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ed061ad0-ed32-4d23-93d6-b5b076f3832c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:23.194793 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ed061ad0-ed32-4d23-93d6-b5b076f3832c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:23.195216 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ed061ad0-ed32-4d23-93d6-b5b076f3832c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:23.209616 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.wsgi [None req-ed061ad0-ed32-4d23-93d6-b5b076f3832c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] HTTP exception thrown: Instance 840d9152-ac7c-4205-b159-d6151037a3be could not be found. Aug 24 08:07:23.211129 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-ed061ad0-ed32-4d23-93d6-b5b076f3832c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Request method failure captured: Aug 24 08:07:23.211129 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: request: GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be HTTP/1.1 Aug 24 08:07:23.211129 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept: application/json Aug 24 08:07:23.211129 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept-Encoding: identity Aug 24 08:07:23.211129 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Connection: close Aug 24 08:07:23.211129 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Length: 0 Aug 24 08:07:23.211129 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Type: application/json Aug 24 08:07:23.211129 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Host: 10.222.0.72 Aug 24 08:07:23.211129 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Openstack-System-Scope: None Aug 24 08:07:23.211129 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: User-Agent: python-urllib3/1.26.11 Aug 24 08:07:23.211129 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Auth-Token: gAAAAABjBdtB8wg4xoATMZUNjy9gDWlG957s7r1lTlMyaQau4EdGEqi-F0s8v1oVa0_NdU26sHO4_YgFT0_VInMP9OLpHuqoP64dfsEuBEPzjsDqYspXwBR-NmoFPBnV18jLOmhWzTuIdL7GDg4xSQXFZKLeBOO3ckV29yKRXUxhmEN99EpbE2A Aug 24 08:07:23.211129 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Id: None Aug 24 08:07:23.211129 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Name: None Aug 24 08:07:23.211129 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Identity-Status: Confirmed Aug 24 08:07:23.211129 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Is-Admin-Project: True Aug 24 08:07:23.211129 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Id: default Aug 24 08:07:23.211129 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Name: Default Aug 24 08:07:23.211129 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Id: ef79c9df5a2541afaeff1a82b3e4a496 Aug 24 08:07:23.211129 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Name: tempest-AttachVolumeTestJSON-2104148936 Aug 24 08:07:23.211129 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Role: reader,member Aug 24 08:07:23.211129 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Roles: reader,member Aug 24 08:07:23.212736 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ef79c9df5a2541afaeff1a82b3e4a496"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ef79c9df5a2541afaeff1a82b3e4a496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ef79c9df5a2541afaeff1a82b3e4a496"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ef79c9df5a2541afaeff1a82b3e4a496"}]}] Aug 24 08:07:23.212736 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant: tempest-AttachVolumeTestJSON-2104148936 Aug 24 08:07:23.212736 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Id: ef79c9df5a2541afaeff1a82b3e4a496 Aug 24 08:07:23.212736 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2104148936 Aug 24 08:07:23.212736 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User: tempest-AttachVolumeTestJSON-2104148936-project Aug 24 08:07:23.212736 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Id: default Aug 24 08:07:23.212736 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Name: Default Aug 24 08:07:23.212736 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Id: a590d584ed654ca399875a5e04a57a24 Aug 24 08:07:23.212736 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Name: tempest-AttachVolumeTestJSON-2104148936-project Aug 24 08:07:23.212736 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: method: > Aug 24 08:07:23.212736 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: exception: Instance 840d9152-ac7c-4205-b159-d6151037a3be could not be found. Aug 24 08:07:23.212736 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: action_args: {'id': '840d9152-ac7c-4205-b159-d6151037a3be'} Aug 24 08:07:23.213766 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:07:23.213766 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:07:23.213766 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:07:23.213766 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:07:23.213766 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:07:23.213766 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:07:23.213766 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:07:23.213766 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:07:23.213766 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:07:23.213766 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:07:23.213766 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 840d9152-ac7c-4205-b159-d6151037a3be could not be found. Aug 24 08:07:23.213766 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:07:23.213766 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:07:23.213766 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:07:23.213766 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:07:23.213766 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:07:23.213766 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:07:23.213766 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:07:23.213766 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:07:23.213766 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:07:23.215206 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:07:23.215206 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:07:23.215206 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:07:23.215206 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:07:23.215206 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:07:23.215206 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:07:23.215206 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:07:23.215206 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 840d9152-ac7c-4205-b159-d6151037a3be could not be found. Aug 24 08:07:23.215206 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:07:23.215206 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:07:23.215206 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:07:23.215206 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:07:23.215206 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:07:23.215206 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:07:23.215206 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:07:23.215206 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:07:23.215206 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 840d9152-ac7c-4205-b159-d6151037a3be could not be found. Aug 24 08:07:23.215206 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:07:23.217345 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-ed061ad0-ed32-4d23-93d6-b5b076f3832c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] Returning 404 to user: Instance 840d9152-ac7c-4205-b159-d6151037a3be could not be found. {{(pid=127590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:07:23.217345 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-ed061ad0-ed32-4d23-93d6-b5b076f3832c tempest-AttachVolumeTestJSON-2104148936 tempest-AttachVolumeTestJSON-2104148936-project] 10.222.0.72 "GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be" status: 404 len: 111 microversion: 2.1 time: 0.032582 Aug 24 08:07:23.217345 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 480/962] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:23 2022] GET /compute/v2.1/servers/840d9152-ac7c-4205-b159-d6151037a3be => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:07:23.640192 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b6b4d9a7-7f4e-427b-bcc8-18d46754e720 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1058880006", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-688278176", "security_groups": [{"name": "tempest-secgroup-smoke-812161139"}], "block_device_mapping_v2": [{"uuid": "68a7f36d-0a32-4de0-9e7f-3e1b72705934", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ba35002a-baf9-48c9-8bd5-ed065d35dab0"}]}} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:07:23.804560 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.network.neutron [None req-b6b4d9a7-7f4e-427b-bcc8-18d46754e720 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] validate_networks() for [('ba35002a-baf9-48c9-8bd5-ed065d35dab0', None, None, None, None, None)] {{(pid=127589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:07:24.413951 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-b6b4d9a7-7f4e-427b-bcc8-18d46754e720 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Flavor limits 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:07:24.420072 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-b6b4d9a7-7f4e-427b-bcc8-18d46754e720 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Image limits 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:07:24.420072 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-b6b4d9a7-7f4e-427b-bcc8-18d46754e720 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Flavor pref 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:07:24.420072 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-b6b4d9a7-7f4e-427b-bcc8-18d46754e720 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Image pref 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:07:24.420072 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-b6b4d9a7-7f4e-427b-bcc8-18d46754e720 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:07:24.429640 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b6b4d9a7-7f4e-427b-bcc8-18d46754e720 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:24.430133 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b6b4d9a7-7f4e-427b-bcc8-18d46754e720 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:24.430934 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b6b4d9a7-7f4e-427b-bcc8-18d46754e720 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:24.431347 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b6b4d9a7-7f4e-427b-bcc8-18d46754e720 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:24.431764 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b6b4d9a7-7f4e-427b-bcc8-18d46754e720 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:24.432383 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b6b4d9a7-7f4e-427b-bcc8-18d46754e720 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:24.450027 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.quota [None req-b6b4d9a7-7f4e-427b-bcc8-18d46754e720 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Getting quotas for project 67da3e4c41e64947bb3e531c5b7550b6. Resources: {'cores', 'instances', 'ram'} {{(pid=127589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:07:24.454776 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.quota [None req-b6b4d9a7-7f4e-427b-bcc8-18d46754e720 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Getting quotas for user 7a279965532e4020876954116f53d3b9 and project 67da3e4c41e64947bb3e531c5b7550b6. Resources: {'cores', 'instances', 'ram'} {{(pid=127589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:07:24.525087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-b6b4d9a7-7f4e-427b-bcc8-18d46754e720 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Going to run 1 instances... {{(pid=127589) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:07:24.527329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-b6b4d9a7-7f4e-427b-bcc8-18d46754e720 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: cc2b21e4-3e3c-456c-88e3-8676721fb366] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='68a7f36d-0a32-4de0-9e7f-3e1b72705934',volume_size=None,volume_type=None)] {{(pid=127589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:07:24.866933 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-b6b4d9a7-7f4e-427b-bcc8-18d46754e720 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.231328 Aug 24 08:07:24.867769 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 483/963] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 24 08:07:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 1233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 08:07:24.880101 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-91b04cd6-5030-491f-bb65-7e0e4c9e4166 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:24.880725 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-91b04cd6-5030-491f-bb65-7e0e4c9e4166 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: cc2b21e4-3e3c-456c-88e3-8676721fb366] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:24.951473 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-91b04cd6-5030-491f-bb65-7e0e4c9e4166 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:24.958340 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-91b04cd6-5030-491f-bb65-7e0e4c9e4166 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366" status: 200 len: 1094 microversion: 2.1 time: 0.083752 Aug 24 08:07:24.973685 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 481/964] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:24 2022] GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366 => generated 1094 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:07:25.982954 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-4c3d5f65-99ef-4b8c-ac05-c62feca4b8da tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:25.983673 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-4c3d5f65-99ef-4b8c-ac05-c62feca4b8da tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: cc2b21e4-3e3c-456c-88e3-8676721fb366] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:25.993801 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4c3d5f65-99ef-4b8c-ac05-c62feca4b8da tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:25.994383 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4c3d5f65-99ef-4b8c-ac05-c62feca4b8da tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:25.994897 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4c3d5f65-99ef-4b8c-ac05-c62feca4b8da tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:25.995681 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4c3d5f65-99ef-4b8c-ac05-c62feca4b8da tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:25.996230 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4c3d5f65-99ef-4b8c-ac05-c62feca4b8da tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:25.996789 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4c3d5f65-99ef-4b8c-ac05-c62feca4b8da tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:26.072108 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-4c3d5f65-99ef-4b8c-ac05-c62feca4b8da tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:26.081020 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-4c3d5f65-99ef-4b8c-ac05-c62feca4b8da tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366" status: 200 len: 1144 microversion: 2.1 time: 0.103402 Aug 24 08:07:26.082225 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 484/965] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:25 2022] GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366 => generated 1144 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:07:27.102706 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-ea1fc514-27b9-4513-afaa-7d746584a8fe tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:27.103318 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-ea1fc514-27b9-4513-afaa-7d746584a8fe tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: cc2b21e4-3e3c-456c-88e3-8676721fb366] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:27.113963 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ea1fc514-27b9-4513-afaa-7d746584a8fe tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:27.114658 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ea1fc514-27b9-4513-afaa-7d746584a8fe tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:27.115250 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ea1fc514-27b9-4513-afaa-7d746584a8fe tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:27.115955 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ea1fc514-27b9-4513-afaa-7d746584a8fe tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:27.116552 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ea1fc514-27b9-4513-afaa-7d746584a8fe tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:27.117558 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ea1fc514-27b9-4513-afaa-7d746584a8fe tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:27.184264 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-ea1fc514-27b9-4513-afaa-7d746584a8fe tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:27.193452 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-ea1fc514-27b9-4513-afaa-7d746584a8fe tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366" status: 200 len: 1210 microversion: 2.1 time: 0.094651 Aug 24 08:07:27.200500 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 482/966] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:27 2022] GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366 => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:07:28.214861 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-a9ce7a77-a4e4-4b4f-84ee-31414277848f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:28.216747 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-a9ce7a77-a4e4-4b4f-84ee-31414277848f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: cc2b21e4-3e3c-456c-88e3-8676721fb366] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:28.224202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a9ce7a77-a4e4-4b4f-84ee-31414277848f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:28.224727 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a9ce7a77-a4e4-4b4f-84ee-31414277848f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:28.225175 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a9ce7a77-a4e4-4b4f-84ee-31414277848f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:28.225898 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a9ce7a77-a4e4-4b4f-84ee-31414277848f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:28.226361 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a9ce7a77-a4e4-4b4f-84ee-31414277848f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:28.226798 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a9ce7a77-a4e4-4b4f-84ee-31414277848f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:28.229697 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:28.435657 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a9ce7a77-a4e4-4b4f-84ee-31414277848f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:28.443696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-a9ce7a77-a4e4-4b4f-84ee-31414277848f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366" status: 200 len: 1265 microversion: 2.1 time: 0.233186 Aug 24 08:07:28.444257 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 485/967] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:28 2022] GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:07:28.803111 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-af429f4a-5c29-40fb-af93-17607d5a772b req-cd4bc9f3-bd6e-4d98-b771-7dab5c694759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc2b21e4-3e3c-456c-88e3-8676721fb366", "tag": "1bc3f63f-39f6-4dd6-aaa6-bbbbf2911f97"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:07:28.819099 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-af429f4a-5c29-40fb-af93-17607d5a772b req-cd4bc9f3-bd6e-4d98-b771-7dab5c694759 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:28.819953 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-af429f4a-5c29-40fb-af93-17607d5a772b req-cd4bc9f3-bd6e-4d98-b771-7dab5c694759 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:28.820452 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-af429f4a-5c29-40fb-af93-17607d5a772b req-cd4bc9f3-bd6e-4d98-b771-7dab5c694759 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:28.833613 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-af429f4a-5c29-40fb-af93-17607d5a772b req-cd4bc9f3-bd6e-4d98-b771-7dab5c694759 service nova] Creating event network-changed:1bc3f63f-39f6-4dd6-aaa6-bbbbf2911f97 for instance cc2b21e4-3e3c-456c-88e3-8676721fb366 on hv-cinder-85427 Aug 24 08:07:28.839249 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-af429f4a-5c29-40fb-af93-17607d5a772b req-cd4bc9f3-bd6e-4d98-b771-7dab5c694759 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045455 Aug 24 08:07:28.839990 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 483/968] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:07:29.466688 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-ca6aec60-cce9-49b3-8bbe-e7fef3159513 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:29.467346 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-ca6aec60-cce9-49b3-8bbe-e7fef3159513 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: cc2b21e4-3e3c-456c-88e3-8676721fb366] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:29.474141 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ca6aec60-cce9-49b3-8bbe-e7fef3159513 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:29.474856 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ca6aec60-cce9-49b3-8bbe-e7fef3159513 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:29.475301 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ca6aec60-cce9-49b3-8bbe-e7fef3159513 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:29.476010 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ca6aec60-cce9-49b3-8bbe-e7fef3159513 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:29.476473 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ca6aec60-cce9-49b3-8bbe-e7fef3159513 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:29.476919 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-ca6aec60-cce9-49b3-8bbe-e7fef3159513 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:29.632370 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-ca6aec60-cce9-49b3-8bbe-e7fef3159513 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:29.641298 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-ca6aec60-cce9-49b3-8bbe-e7fef3159513 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366" status: 200 len: 1265 microversion: 2.1 time: 0.178326 Aug 24 08:07:29.641906 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 486/969] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:29 2022] GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:07:30.665589 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-fd4c555a-b947-404a-8d8a-3348885d62dc tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:30.666196 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-fd4c555a-b947-404a-8d8a-3348885d62dc tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: cc2b21e4-3e3c-456c-88e3-8676721fb366] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:30.673392 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fd4c555a-b947-404a-8d8a-3348885d62dc tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:30.673868 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fd4c555a-b947-404a-8d8a-3348885d62dc tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:30.674306 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fd4c555a-b947-404a-8d8a-3348885d62dc tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:30.674994 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fd4c555a-b947-404a-8d8a-3348885d62dc tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:30.675439 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fd4c555a-b947-404a-8d8a-3348885d62dc tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:30.675854 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fd4c555a-b947-404a-8d8a-3348885d62dc tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:30.824031 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-fd4c555a-b947-404a-8d8a-3348885d62dc tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:30.832643 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-fd4c555a-b947-404a-8d8a-3348885d62dc tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366" status: 200 len: 1265 microversion: 2.1 time: 0.172313 Aug 24 08:07:30.833484 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 484/970] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:30 2022] GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:07:31.856096 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-cd6384b2-9554-4bea-8e42-61182b1c7972 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:31.859063 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-cd6384b2-9554-4bea-8e42-61182b1c7972 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: cc2b21e4-3e3c-456c-88e3-8676721fb366] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:31.865306 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cd6384b2-9554-4bea-8e42-61182b1c7972 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:31.865805 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cd6384b2-9554-4bea-8e42-61182b1c7972 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:31.866250 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cd6384b2-9554-4bea-8e42-61182b1c7972 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:31.866966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cd6384b2-9554-4bea-8e42-61182b1c7972 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:31.867422 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cd6384b2-9554-4bea-8e42-61182b1c7972 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:31.868031 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cd6384b2-9554-4bea-8e42-61182b1c7972 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:32.024447 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-cd6384b2-9554-4bea-8e42-61182b1c7972 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:32.033005 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-cd6384b2-9554-4bea-8e42-61182b1c7972 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366" status: 200 len: 1265 microversion: 2.1 time: 0.182219 Aug 24 08:07:32.033769 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 487/971] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:31 2022] GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:07:33.054695 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-f07b2b70-cd67-4f43-aefb-40639397909f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:33.055487 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-f07b2b70-cd67-4f43-aefb-40639397909f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: cc2b21e4-3e3c-456c-88e3-8676721fb366] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:33.063457 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f07b2b70-cd67-4f43-aefb-40639397909f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:33.064107 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f07b2b70-cd67-4f43-aefb-40639397909f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:33.064705 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f07b2b70-cd67-4f43-aefb-40639397909f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:33.065621 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f07b2b70-cd67-4f43-aefb-40639397909f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:33.066244 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f07b2b70-cd67-4f43-aefb-40639397909f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:33.066683 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-f07b2b70-cd67-4f43-aefb-40639397909f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:33.214341 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-f07b2b70-cd67-4f43-aefb-40639397909f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:33.223662 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-f07b2b70-cd67-4f43-aefb-40639397909f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366" status: 200 len: 1265 microversion: 2.1 time: 0.173100 Aug 24 08:07:33.224238 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 485/972] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:33 2022] GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:07:34.245572 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-62a92dca-ee0b-4c22-986e-0d01fd5787ba tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:34.246192 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-62a92dca-ee0b-4c22-986e-0d01fd5787ba tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: cc2b21e4-3e3c-456c-88e3-8676721fb366] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:34.253183 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-62a92dca-ee0b-4c22-986e-0d01fd5787ba tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:34.253905 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-62a92dca-ee0b-4c22-986e-0d01fd5787ba tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:34.254622 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-62a92dca-ee0b-4c22-986e-0d01fd5787ba tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:34.255506 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-62a92dca-ee0b-4c22-986e-0d01fd5787ba tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:34.256131 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-62a92dca-ee0b-4c22-986e-0d01fd5787ba tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:34.256558 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-62a92dca-ee0b-4c22-986e-0d01fd5787ba tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:34.440358 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=2 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:34.462145 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=6 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:34.480144 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-62a92dca-ee0b-4c22-986e-0d01fd5787ba tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:34.489451 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-62a92dca-ee0b-4c22-986e-0d01fd5787ba tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366" status: 200 len: 1265 microversion: 2.1 time: 0.247857 Aug 24 08:07:34.495662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 488/973] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:34 2022] GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366 => generated 1265 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:07:35.104072 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=2 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:35.218500 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-a349d2cf-049b-4c15-aadb-ab536f280150 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Action: 'create', calling method: .version_select at 0x7f3210a1ab80>, body: {"keypair": {"name": "tempest-keypair-18046273", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKY3ROTc1cVFV4mpW5+Ck7X5MmZsPznQkiyEUFVoyWpuaILMHwPjjbhQQy7mL/SqnHL8vz9wXIDZb/upZXhWtMkuoH8dW+LuOu7Trcz8zOr4cqkgmYBkTubOKCck6dobdg=="}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:07:35.234762 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-a349d2cf-049b-4c15-aadb-ab536f280150 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Getting quotas for project 2d92c8aa6d4d46538574779ae23ac398. Resources: {'key_pairs'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:07:35.238706 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-a349d2cf-049b-4c15-aadb-ab536f280150 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Getting quotas for user 5344a1d76e764da9b08f4cb7a2bd8ca5 and project 2d92c8aa6d4d46538574779ae23ac398. Resources: {'key_pairs'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:07:35.327831 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-a349d2cf-049b-4c15-aadb-ab536f280150 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.228709 Aug 24 08:07:35.329291 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 486/974] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 24 08:07:35 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:07:35.510697 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-fbedfa19-40a5-4048-9fe8-751d52926e1a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:35.511317 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-fbedfa19-40a5-4048-9fe8-751d52926e1a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: cc2b21e4-3e3c-456c-88e3-8676721fb366] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:35.518596 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fbedfa19-40a5-4048-9fe8-751d52926e1a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:35.519096 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fbedfa19-40a5-4048-9fe8-751d52926e1a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:35.519539 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fbedfa19-40a5-4048-9fe8-751d52926e1a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:35.520251 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fbedfa19-40a5-4048-9fe8-751d52926e1a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:35.520742 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fbedfa19-40a5-4048-9fe8-751d52926e1a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:35.521204 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fbedfa19-40a5-4048-9fe8-751d52926e1a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:35.699853 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-fbedfa19-40a5-4048-9fe8-751d52926e1a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:35.707928 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-fbedfa19-40a5-4048-9fe8-751d52926e1a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366" status: 200 len: 1265 microversion: 2.1 time: 0.201470 Aug 24 08:07:35.708502 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 489/975] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:35 2022] GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366 => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:07:36.729822 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-50da8e73-9ddb-4b7b-80e8-88fa57e1c11a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:36.730442 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-50da8e73-9ddb-4b7b-80e8-88fa57e1c11a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: cc2b21e4-3e3c-456c-88e3-8676721fb366] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:36.738053 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-50da8e73-9ddb-4b7b-80e8-88fa57e1c11a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:36.738546 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-50da8e73-9ddb-4b7b-80e8-88fa57e1c11a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:36.738986 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-50da8e73-9ddb-4b7b-80e8-88fa57e1c11a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:36.739693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-50da8e73-9ddb-4b7b-80e8-88fa57e1c11a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:36.740140 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-50da8e73-9ddb-4b7b-80e8-88fa57e1c11a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:36.740800 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-50da8e73-9ddb-4b7b-80e8-88fa57e1c11a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:36.951559 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-50da8e73-9ddb-4b7b-80e8-88fa57e1c11a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:36.961115 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-50da8e73-9ddb-4b7b-80e8-88fa57e1c11a tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366" status: 200 len: 1265 microversion: 2.1 time: 0.235574 Aug 24 08:07:36.961830 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 487/976] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:36 2022] GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366 => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:07:37.636124 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-cbc6d5eb-af89-488c-98c3-78d0c21dc570 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1103058752", "imageRef": "ccdab334-55ce-4ff5-bd97-5a424660c282", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2af2cfe3-fbb0-4b30-a7f7-b293ddfab728"}], "security_groups": [{"name": "tempest-securitygroup--526368070"}], "key_name": "tempest-keypair-18046273", "user_data": "}} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:07:37.750794 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.network.neutron [None req-cbc6d5eb-af89-488c-98c3-78d0c21dc570 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] validate_networks() for [('2af2cfe3-fbb0-4b30-a7f7-b293ddfab728', None, None, None, None, None)] {{(pid=127589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:07:37.984282 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-787b7328-aff8-4dec-8452-ba2ae9a23456 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:37.984929 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-787b7328-aff8-4dec-8452-ba2ae9a23456 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: cc2b21e4-3e3c-456c-88e3-8676721fb366] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:37.991915 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-787b7328-aff8-4dec-8452-ba2ae9a23456 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:37.994391 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-787b7328-aff8-4dec-8452-ba2ae9a23456 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:37.994391 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-787b7328-aff8-4dec-8452-ba2ae9a23456 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:37.994391 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-787b7328-aff8-4dec-8452-ba2ae9a23456 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:37.994391 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-787b7328-aff8-4dec-8452-ba2ae9a23456 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:37.994876 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-787b7328-aff8-4dec-8452-ba2ae9a23456 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:38.156830 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-787b7328-aff8-4dec-8452-ba2ae9a23456 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:38.159961 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-cbc6d5eb-af89-488c-98c3-78d0c21dc570 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Flavor limits 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:07:38.160726 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-cbc6d5eb-af89-488c-98c3-78d0c21dc570 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Image limits 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:07:38.161374 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-cbc6d5eb-af89-488c-98c3-78d0c21dc570 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Flavor pref 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:07:38.161937 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-cbc6d5eb-af89-488c-98c3-78d0c21dc570 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Image pref 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:07:38.162501 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-cbc6d5eb-af89-488c-98c3-78d0c21dc570 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:07:38.168891 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-787b7328-aff8-4dec-8452-ba2ae9a23456 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366" status: 200 len: 1265 microversion: 2.1 time: 0.189674 Aug 24 08:07:38.176622 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cbc6d5eb-af89-488c-98c3-78d0c21dc570 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:38.177372 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cbc6d5eb-af89-488c-98c3-78d0c21dc570 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:38.177959 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cbc6d5eb-af89-488c-98c3-78d0c21dc570 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:38.178876 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cbc6d5eb-af89-488c-98c3-78d0c21dc570 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:38.179493 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cbc6d5eb-af89-488c-98c3-78d0c21dc570 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:38.180087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cbc6d5eb-af89-488c-98c3-78d0c21dc570 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:38.184578 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 488/977] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:37 2022] GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:07:38.202365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.quota [None req-cbc6d5eb-af89-488c-98c3-78d0c21dc570 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Getting quotas for project 2d92c8aa6d4d46538574779ae23ac398. Resources: {'cores', 'instances', 'ram'} {{(pid=127589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:07:38.207066 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.quota [None req-cbc6d5eb-af89-488c-98c3-78d0c21dc570 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Getting quotas for user 5344a1d76e764da9b08f4cb7a2bd8ca5 and project 2d92c8aa6d4d46538574779ae23ac398. Resources: {'cores', 'instances', 'ram'} {{(pid=127589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:07:38.219844 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-cbc6d5eb-af89-488c-98c3-78d0c21dc570 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Going to run 1 instances... {{(pid=127589) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:07:38.222191 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-cbc6d5eb-af89-488c-98c3-78d0c21dc570 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: ab2c4538-253e-44ea-8fb9-e392f59cb6f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccdab334-55ce-4ff5-bd97-5a424660c282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:07:38.346668 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-cbc6d5eb-af89-488c-98c3-78d0c21dc570 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.714818 Aug 24 08:07:38.347322 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 490/978] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 24 08:07:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 08:07:38.359704 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-6cfaeaa1-8dd8-4d3d-b5ed-4b4e975345de tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:38.360574 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-6cfaeaa1-8dd8-4d3d-b5ed-4b4e975345de tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: ab2c4538-253e-44ea-8fb9-e392f59cb6f1] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:38.432958 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-6cfaeaa1-8dd8-4d3d-b5ed-4b4e975345de tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:38.441309 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-6cfaeaa1-8dd8-4d3d-b5ed-4b4e975345de tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1" status: 200 len: 1240 microversion: 2.1 time: 0.086766 Aug 24 08:07:38.443302 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 489/979] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:38 2022] GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1 => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:07:39.191648 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-460fe485-134b-48dd-82b6-a98065ddf205 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:39.192347 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-460fe485-134b-48dd-82b6-a98065ddf205 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: cc2b21e4-3e3c-456c-88e3-8676721fb366] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:39.198985 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-460fe485-134b-48dd-82b6-a98065ddf205 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:39.199484 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-460fe485-134b-48dd-82b6-a98065ddf205 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:39.199926 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-460fe485-134b-48dd-82b6-a98065ddf205 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:39.200642 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-460fe485-134b-48dd-82b6-a98065ddf205 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:39.201821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-460fe485-134b-48dd-82b6-a98065ddf205 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:39.202306 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-460fe485-134b-48dd-82b6-a98065ddf205 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:39.341583 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-460fe485-134b-48dd-82b6-a98065ddf205 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:39.349288 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-460fe485-134b-48dd-82b6-a98065ddf205 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366" status: 200 len: 1265 microversion: 2.1 time: 0.162146 Aug 24 08:07:39.349839 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 491/980] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:39 2022] GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:07:39.461778 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-26748961-a29d-4449-bf4a-d469224fadd0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:39.462508 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-26748961-a29d-4449-bf4a-d469224fadd0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: ab2c4538-253e-44ea-8fb9-e392f59cb6f1] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:39.470534 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-26748961-a29d-4449-bf4a-d469224fadd0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:39.471416 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-26748961-a29d-4449-bf4a-d469224fadd0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:39.471989 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-26748961-a29d-4449-bf4a-d469224fadd0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:39.472216 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-26748961-a29d-4449-bf4a-d469224fadd0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:39.472601 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-26748961-a29d-4449-bf4a-d469224fadd0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:39.473068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-26748961-a29d-4449-bf4a-d469224fadd0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:39.543307 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-26748961-a29d-4449-bf4a-d469224fadd0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:39.551773 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-26748961-a29d-4449-bf4a-d469224fadd0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1" status: 200 len: 1244 microversion: 2.1 time: 0.093801 Aug 24 08:07:39.553938 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 490/981] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:39 2022] GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1 => generated 1244 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:07:40.370546 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-3f706e59-16b0-4871-ad15-4d43857f2232 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:40.371555 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-3f706e59-16b0-4871-ad15-4d43857f2232 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: cc2b21e4-3e3c-456c-88e3-8676721fb366] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:40.378026 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3f706e59-16b0-4871-ad15-4d43857f2232 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:40.378820 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3f706e59-16b0-4871-ad15-4d43857f2232 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:40.379485 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3f706e59-16b0-4871-ad15-4d43857f2232 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:40.380434 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3f706e59-16b0-4871-ad15-4d43857f2232 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:40.381657 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3f706e59-16b0-4871-ad15-4d43857f2232 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:40.382238 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3f706e59-16b0-4871-ad15-4d43857f2232 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:40.431662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-c16b21a4-f766-42b4-b05f-6198be8483b3 req-fece6a2d-ce9c-4671-9124-06f429f05509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc2b21e4-3e3c-456c-88e3-8676721fb366", "name": "network-vif-plugged", "status": "completed", "tag": "1bc3f63f-39f6-4dd6-aaa6-bbbbf2911f97"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:07:40.442493 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-c16b21a4-f766-42b4-b05f-6198be8483b3 req-fece6a2d-ce9c-4671-9124-06f429f05509 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:40.443234 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-c16b21a4-f766-42b4-b05f-6198be8483b3 req-fece6a2d-ce9c-4671-9124-06f429f05509 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:40.443667 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-c16b21a4-f766-42b4-b05f-6198be8483b3 req-fece6a2d-ce9c-4671-9124-06f429f05509 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:40.456709 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-c16b21a4-f766-42b4-b05f-6198be8483b3 req-fece6a2d-ce9c-4671-9124-06f429f05509 service nova] Creating event network-vif-plugged:1bc3f63f-39f6-4dd6-aaa6-bbbbf2911f97 for instance cc2b21e4-3e3c-456c-88e3-8676721fb366 on hv-cinder-85427 Aug 24 08:07:40.462381 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-c16b21a4-f766-42b4-b05f-6198be8483b3 req-fece6a2d-ce9c-4671-9124-06f429f05509 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112167 Aug 24 08:07:40.463282 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 492/982] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:07:40.554946 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-3f706e59-16b0-4871-ad15-4d43857f2232 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:40.562827 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-3f706e59-16b0-4871-ad15-4d43857f2232 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366" status: 200 len: 1265 microversion: 2.1 time: 0.196446 Aug 24 08:07:40.563409 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 491/983] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:40 2022] GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:07:40.573552 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-86c9496f-7f17-4aa4-8830-36e368becaec tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:40.574250 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-86c9496f-7f17-4aa4-8830-36e368becaec tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: ab2c4538-253e-44ea-8fb9-e392f59cb6f1] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:40.581040 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-86c9496f-7f17-4aa4-8830-36e368becaec tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:40.581521 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-86c9496f-7f17-4aa4-8830-36e368becaec tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:40.581956 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-86c9496f-7f17-4aa4-8830-36e368becaec tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:40.582647 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-86c9496f-7f17-4aa4-8830-36e368becaec tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:40.583099 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-86c9496f-7f17-4aa4-8830-36e368becaec tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:40.583522 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-86c9496f-7f17-4aa4-8830-36e368becaec tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:40.647542 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-86c9496f-7f17-4aa4-8830-36e368becaec tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:40.656916 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-86c9496f-7f17-4aa4-8830-36e368becaec tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1" status: 200 len: 1300 microversion: 2.1 time: 0.087471 Aug 24 08:07:40.669083 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 493/984] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:40 2022] GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1 => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:07:41.583325 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-7e978cfe-cdec-4fba-8929-a40757db7af1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:41.584100 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-7e978cfe-cdec-4fba-8929-a40757db7af1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: cc2b21e4-3e3c-456c-88e3-8676721fb366] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:41.592225 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7e978cfe-cdec-4fba-8929-a40757db7af1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:41.592981 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7e978cfe-cdec-4fba-8929-a40757db7af1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:41.593388 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7e978cfe-cdec-4fba-8929-a40757db7af1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:41.594172 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7e978cfe-cdec-4fba-8929-a40757db7af1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:41.594701 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7e978cfe-cdec-4fba-8929-a40757db7af1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:41.595362 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-7e978cfe-cdec-4fba-8929-a40757db7af1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:41.680845 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-db3a5842-8b95-4872-9bbe-b7f7067182de tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:41.681455 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-db3a5842-8b95-4872-9bbe-b7f7067182de tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: ab2c4538-253e-44ea-8fb9-e392f59cb6f1] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:41.688342 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-db3a5842-8b95-4872-9bbe-b7f7067182de tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:41.688862 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-db3a5842-8b95-4872-9bbe-b7f7067182de tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:41.689302 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-db3a5842-8b95-4872-9bbe-b7f7067182de tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:41.690002 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-db3a5842-8b95-4872-9bbe-b7f7067182de tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:41.690624 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-db3a5842-8b95-4872-9bbe-b7f7067182de tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:41.691046 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-db3a5842-8b95-4872-9bbe-b7f7067182de tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:41.742017 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-7e978cfe-cdec-4fba-8929-a40757db7af1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:41.750415 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-7e978cfe-cdec-4fba-8929-a40757db7af1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366" status: 200 len: 1265 microversion: 2.1 time: 0.170875 Aug 24 08:07:41.751108 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 492/985] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:41 2022] GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:07:41.899825 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-db3a5842-8b95-4872-9bbe-b7f7067182de tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:41.908572 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-db3a5842-8b95-4872-9bbe-b7f7067182de tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1" status: 200 len: 1365 microversion: 2.1 time: 0.231606 Aug 24 08:07:41.909182 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 494/986] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:41 2022] GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1 => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:07:42.303356 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-f648a294-c561-4f1d-b1c7-ebe64884afd9 req-2f9ac621-c16e-4bbf-881f-85f15ee58cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab2c4538-253e-44ea-8fb9-e392f59cb6f1", "tag": "8853b076-349a-4e2c-a58b-48611309257f"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:07:42.313328 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-f648a294-c561-4f1d-b1c7-ebe64884afd9 req-2f9ac621-c16e-4bbf-881f-85f15ee58cf6 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:42.313812 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-f648a294-c561-4f1d-b1c7-ebe64884afd9 req-2f9ac621-c16e-4bbf-881f-85f15ee58cf6 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:42.314248 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-f648a294-c561-4f1d-b1c7-ebe64884afd9 req-2f9ac621-c16e-4bbf-881f-85f15ee58cf6 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:42.324910 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-f648a294-c561-4f1d-b1c7-ebe64884afd9 req-2f9ac621-c16e-4bbf-881f-85f15ee58cf6 service nova] Creating event network-changed:8853b076-349a-4e2c-a58b-48611309257f for instance ab2c4538-253e-44ea-8fb9-e392f59cb6f1 on hv-cinder-85427 Aug 24 08:07:42.330421 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-f648a294-c561-4f1d-b1c7-ebe64884afd9 req-2f9ac621-c16e-4bbf-881f-85f15ee58cf6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030711 Aug 24 08:07:42.331010 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 493/987] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:07:42.771617 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-dcb3d66d-6bda-4b7c-a413-d1c380c16062 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:42.772343 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-dcb3d66d-6bda-4b7c-a413-d1c380c16062 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: cc2b21e4-3e3c-456c-88e3-8676721fb366] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:42.779432 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-dcb3d66d-6bda-4b7c-a413-d1c380c16062 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:42.780186 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-dcb3d66d-6bda-4b7c-a413-d1c380c16062 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:42.780698 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-dcb3d66d-6bda-4b7c-a413-d1c380c16062 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:42.781390 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-dcb3d66d-6bda-4b7c-a413-d1c380c16062 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:42.781845 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-dcb3d66d-6bda-4b7c-a413-d1c380c16062 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:42.787034 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-dcb3d66d-6bda-4b7c-a413-d1c380c16062 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:42.930485 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-9e5e80b3-b3e8-4eb4-8c65-08a5da8fc06e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:42.931171 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-9e5e80b3-b3e8-4eb4-8c65-08a5da8fc06e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: ab2c4538-253e-44ea-8fb9-e392f59cb6f1] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:42.938164 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e5e80b3-b3e8-4eb4-8c65-08a5da8fc06e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:42.938642 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e5e80b3-b3e8-4eb4-8c65-08a5da8fc06e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:42.939073 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e5e80b3-b3e8-4eb4-8c65-08a5da8fc06e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:42.939759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e5e80b3-b3e8-4eb4-8c65-08a5da8fc06e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:42.940209 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e5e80b3-b3e8-4eb4-8c65-08a5da8fc06e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:42.940628 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9e5e80b3-b3e8-4eb4-8c65-08a5da8fc06e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:43.011364 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-dcb3d66d-6bda-4b7c-a413-d1c380c16062 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:43.019770 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-dcb3d66d-6bda-4b7c-a413-d1c380c16062 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366" status: 200 len: 1451 microversion: 2.1 time: 0.252069 Aug 24 08:07:43.020447 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 495/988] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:42 2022] GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366 => generated 1451 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:07:43.041365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-75ddc09c-8bd7-4193-8d75-1c462935a91b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:43.042137 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-75ddc09c-8bd7-4193-8d75-1c462935a91b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: cc2b21e4-3e3c-456c-88e3-8676721fb366] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:43.049286 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-75ddc09c-8bd7-4193-8d75-1c462935a91b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:43.049770 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-75ddc09c-8bd7-4193-8d75-1c462935a91b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:43.050205 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-75ddc09c-8bd7-4193-8d75-1c462935a91b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:43.050905 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-75ddc09c-8bd7-4193-8d75-1c462935a91b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:43.051388 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-75ddc09c-8bd7-4193-8d75-1c462935a91b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:43.051806 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-75ddc09c-8bd7-4193-8d75-1c462935a91b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:43.083568 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9e5e80b3-b3e8-4eb4-8c65-08a5da8fc06e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:43.092028 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-9e5e80b3-b3e8-4eb4-8c65-08a5da8fc06e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1" status: 200 len: 1365 microversion: 2.1 time: 0.165652 Aug 24 08:07:43.092591 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 494/989] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:42 2022] GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:07:43.297198 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-75ddc09c-8bd7-4193-8d75-1c462935a91b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:43.305748 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-75ddc09c-8bd7-4193-8d75-1c462935a91b tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366" status: 200 len: 1451 microversion: 2.1 time: 0.268330 Aug 24 08:07:43.306334 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 496/990] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:43 2022] GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366 => generated 1451 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:07:44.112129 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-31153e83-57e4-4168-a8fb-bb3b4039d246 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:44.112770 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-31153e83-57e4-4168-a8fb-bb3b4039d246 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: ab2c4538-253e-44ea-8fb9-e392f59cb6f1] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:44.119308 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-31153e83-57e4-4168-a8fb-bb3b4039d246 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:44.119791 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-31153e83-57e4-4168-a8fb-bb3b4039d246 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:44.120229 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-31153e83-57e4-4168-a8fb-bb3b4039d246 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:44.121016 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-31153e83-57e4-4168-a8fb-bb3b4039d246 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:44.121773 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-31153e83-57e4-4168-a8fb-bb3b4039d246 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:44.121902 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-31153e83-57e4-4168-a8fb-bb3b4039d246 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:44.255456 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-31153e83-57e4-4168-a8fb-bb3b4039d246 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:44.265095 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-31153e83-57e4-4168-a8fb-bb3b4039d246 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1" status: 200 len: 1365 microversion: 2.1 time: 0.156784 Aug 24 08:07:44.265666 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 495/991] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:44 2022] GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:07:45.287163 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-3989db38-7089-4d55-8a3b-d24a0d65508e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:45.287834 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-3989db38-7089-4d55-8a3b-d24a0d65508e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: ab2c4538-253e-44ea-8fb9-e392f59cb6f1] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:45.295789 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3989db38-7089-4d55-8a3b-d24a0d65508e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:45.296520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3989db38-7089-4d55-8a3b-d24a0d65508e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:45.297220 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3989db38-7089-4d55-8a3b-d24a0d65508e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:45.297955 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3989db38-7089-4d55-8a3b-d24a0d65508e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:45.298407 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3989db38-7089-4d55-8a3b-d24a0d65508e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:45.298827 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3989db38-7089-4d55-8a3b-d24a0d65508e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:45.520525 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-3989db38-7089-4d55-8a3b-d24a0d65508e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:45.529176 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-3989db38-7089-4d55-8a3b-d24a0d65508e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1" status: 200 len: 1365 microversion: 2.1 time: 0.245445 Aug 24 08:07:45.529766 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 497/992] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:45 2022] GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1 => generated 1365 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:07:45.633663 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-68e67cff-c87e-4b2c-8e54-180031dbf4f5 req-5d038bfe-23d1-4cff-86f0-0f2060a4cd16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc2b21e4-3e3c-456c-88e3-8676721fb366", "tag": "1bc3f63f-39f6-4dd6-aaa6-bbbbf2911f97"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:07:45.644164 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-68e67cff-c87e-4b2c-8e54-180031dbf4f5 req-5d038bfe-23d1-4cff-86f0-0f2060a4cd16 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:45.644664 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-68e67cff-c87e-4b2c-8e54-180031dbf4f5 req-5d038bfe-23d1-4cff-86f0-0f2060a4cd16 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:45.645125 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-68e67cff-c87e-4b2c-8e54-180031dbf4f5 req-5d038bfe-23d1-4cff-86f0-0f2060a4cd16 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:45.657242 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-68e67cff-c87e-4b2c-8e54-180031dbf4f5 req-5d038bfe-23d1-4cff-86f0-0f2060a4cd16 service nova] Creating event network-changed:1bc3f63f-39f6-4dd6-aaa6-bbbbf2911f97 for instance cc2b21e4-3e3c-456c-88e3-8676721fb366 on hv-cinder-85427 Aug 24 08:07:45.662948 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-68e67cff-c87e-4b2c-8e54-180031dbf4f5 req-5d038bfe-23d1-4cff-86f0-0f2060a4cd16 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032703 Aug 24 08:07:45.667590 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 496/993] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:07:46.551690 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-08de646a-b078-42b8-bbd5-3c31587990a6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:46.552473 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-08de646a-b078-42b8-bbd5-3c31587990a6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: ab2c4538-253e-44ea-8fb9-e392f59cb6f1] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:46.559486 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-08de646a-b078-42b8-bbd5-3c31587990a6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:46.560575 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-08de646a-b078-42b8-bbd5-3c31587990a6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:46.561297 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-08de646a-b078-42b8-bbd5-3c31587990a6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:46.562022 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-08de646a-b078-42b8-bbd5-3c31587990a6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:46.562500 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-08de646a-b078-42b8-bbd5-3c31587990a6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:46.562932 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-08de646a-b078-42b8-bbd5-3c31587990a6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:46.709944 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-08de646a-b078-42b8-bbd5-3c31587990a6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:46.718487 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-08de646a-b078-42b8-bbd5-3c31587990a6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1" status: 200 len: 1365 microversion: 2.1 time: 0.170845 Aug 24 08:07:46.719068 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 498/994] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:46 2022] GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:07:47.740315 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-5af0dc42-1707-4641-8548-546c26d60299 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:47.741055 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-5af0dc42-1707-4641-8548-546c26d60299 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: ab2c4538-253e-44ea-8fb9-e392f59cb6f1] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:47.747679 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5af0dc42-1707-4641-8548-546c26d60299 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:47.748168 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5af0dc42-1707-4641-8548-546c26d60299 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:47.748605 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5af0dc42-1707-4641-8548-546c26d60299 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:47.749321 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5af0dc42-1707-4641-8548-546c26d60299 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:47.749836 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5af0dc42-1707-4641-8548-546c26d60299 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:47.750211 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5af0dc42-1707-4641-8548-546c26d60299 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:47.877204 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-5af0dc42-1707-4641-8548-546c26d60299 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:47.884741 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-5af0dc42-1707-4641-8548-546c26d60299 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1" status: 200 len: 1365 microversion: 2.1 time: 0.148623 Aug 24 08:07:47.885294 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 497/995] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:47 2022] GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:07:48.441147 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-b8b77daf-d5e0-4e18-b82b-f7bb7d65c0fb req-0f3ea4a5-7974-418b-b05d-7f829d89e21e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab2c4538-253e-44ea-8fb9-e392f59cb6f1", "name": "network-vif-plugged", "status": "completed", "tag": "8853b076-349a-4e2c-a58b-48611309257f"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:07:48.446805 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=2 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:48.447462 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=6 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:48.453262 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-b8b77daf-d5e0-4e18-b82b-f7bb7d65c0fb req-0f3ea4a5-7974-418b-b05d-7f829d89e21e service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:48.453997 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-b8b77daf-d5e0-4e18-b82b-f7bb7d65c0fb req-0f3ea4a5-7974-418b-b05d-7f829d89e21e service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:48.454265 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-b8b77daf-d5e0-4e18-b82b-f7bb7d65c0fb req-0f3ea4a5-7974-418b-b05d-7f829d89e21e service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:48.465498 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-b8b77daf-d5e0-4e18-b82b-f7bb7d65c0fb req-0f3ea4a5-7974-418b-b05d-7f829d89e21e service nova] Creating event network-vif-plugged:8853b076-349a-4e2c-a58b-48611309257f for instance ab2c4538-253e-44ea-8fb9-e392f59cb6f1 on hv-cinder-85427 Aug 24 08:07:48.470531 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-b8b77daf-d5e0-4e18-b82b-f7bb7d65c0fb req-0f3ea4a5-7974-418b-b05d-7f829d89e21e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033365 Aug 24 08:07:48.471114 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 499/996] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:07:48.907219 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-e1d51a00-afd9-4299-953a-b6130b71b927 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:48.907841 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-e1d51a00-afd9-4299-953a-b6130b71b927 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: ab2c4538-253e-44ea-8fb9-e392f59cb6f1] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:48.909940 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=6 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:48.915335 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e1d51a00-afd9-4299-953a-b6130b71b927 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:48.915962 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e1d51a00-afd9-4299-953a-b6130b71b927 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:48.916356 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e1d51a00-afd9-4299-953a-b6130b71b927 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:48.917088 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e1d51a00-afd9-4299-953a-b6130b71b927 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:48.917544 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e1d51a00-afd9-4299-953a-b6130b71b927 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:48.917969 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e1d51a00-afd9-4299-953a-b6130b71b927 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:49.052124 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-e1d51a00-afd9-4299-953a-b6130b71b927 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:49.059754 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-e1d51a00-afd9-4299-953a-b6130b71b927 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1" status: 200 len: 1365 microversion: 2.1 time: 0.157046 Aug 24 08:07:49.060303 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 498/997] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:48 2022] GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:07:50.082450 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-1b31e2e7-be11-43aa-9ce7-5af6d2ca99b6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:50.083183 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-1b31e2e7-be11-43aa-9ce7-5af6d2ca99b6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: ab2c4538-253e-44ea-8fb9-e392f59cb6f1] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:50.089779 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1b31e2e7-be11-43aa-9ce7-5af6d2ca99b6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:50.090265 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1b31e2e7-be11-43aa-9ce7-5af6d2ca99b6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:50.090703 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1b31e2e7-be11-43aa-9ce7-5af6d2ca99b6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:50.091400 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1b31e2e7-be11-43aa-9ce7-5af6d2ca99b6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:50.091860 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1b31e2e7-be11-43aa-9ce7-5af6d2ca99b6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:50.092291 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-1b31e2e7-be11-43aa-9ce7-5af6d2ca99b6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:50.220080 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-1b31e2e7-be11-43aa-9ce7-5af6d2ca99b6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:50.227801 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-1b31e2e7-be11-43aa-9ce7-5af6d2ca99b6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1" status: 200 len: 1365 microversion: 2.1 time: 0.151468 Aug 24 08:07:50.228369 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 500/998] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:50 2022] GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:07:51.248523 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-b77506c3-25ba-40d2-9e34-a7499043a73e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:51.249192 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-b77506c3-25ba-40d2-9e34-a7499043a73e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: ab2c4538-253e-44ea-8fb9-e392f59cb6f1] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:51.255776 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b77506c3-25ba-40d2-9e34-a7499043a73e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:51.256256 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b77506c3-25ba-40d2-9e34-a7499043a73e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:51.256718 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b77506c3-25ba-40d2-9e34-a7499043a73e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:51.257409 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b77506c3-25ba-40d2-9e34-a7499043a73e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:51.257855 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b77506c3-25ba-40d2-9e34-a7499043a73e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:51.258277 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b77506c3-25ba-40d2-9e34-a7499043a73e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:51.386732 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-b77506c3-25ba-40d2-9e34-a7499043a73e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:07:51.394634 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-b77506c3-25ba-40d2-9e34-a7499043a73e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1" status: 200 len: 1555 microversion: 2.1 time: 0.150140 Aug 24 08:07:51.395199 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 499/999] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:07:51 2022] GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:07:51.415521 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-59e4819a-1f96-4038-9597-9ede731cac8e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:07:51.415997 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-59e4819a-1f96-4038-9597-9ede731cac8e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: ab2c4538-253e-44ea-8fb9-e392f59cb6f1] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:07:51.424635 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-59e4819a-1f96-4038-9597-9ede731cac8e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:51.425595 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-59e4819a-1f96-4038-9597-9ede731cac8e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:51.426130 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-59e4819a-1f96-4038-9597-9ede731cac8e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:51.426926 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-59e4819a-1f96-4038-9597-9ede731cac8e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:51.427688 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-59e4819a-1f96-4038-9597-9ede731cac8e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:51.429671 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-59e4819a-1f96-4038-9597-9ede731cac8e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:51.508790 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-59e4819a-1f96-4038-9597-9ede731cac8e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097206 Aug 24 08:07:51.509385 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 501/1000] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 24 08:07:51 2022] GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:07:52.496859 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-d1a034fc-6b8b-4977-b48c-fdfe8a4f0c62 req-5840a8ea-04f4-4884-a886-fe2ca68be7ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab2c4538-253e-44ea-8fb9-e392f59cb6f1", "tag": "8853b076-349a-4e2c-a58b-48611309257f"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:07:52.506822 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-d1a034fc-6b8b-4977-b48c-fdfe8a4f0c62 req-5840a8ea-04f4-4884-a886-fe2ca68be7ee service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:07:52.507558 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-d1a034fc-6b8b-4977-b48c-fdfe8a4f0c62 req-5840a8ea-04f4-4884-a886-fe2ca68be7ee service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:07:52.507987 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-d1a034fc-6b8b-4977-b48c-fdfe8a4f0c62 req-5840a8ea-04f4-4884-a886-fe2ca68be7ee service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:07:52.519264 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-d1a034fc-6b8b-4977-b48c-fdfe8a4f0c62 req-5840a8ea-04f4-4884-a886-fe2ca68be7ee service nova] Creating event network-changed:8853b076-349a-4e2c-a58b-48611309257f for instance ab2c4538-253e-44ea-8fb9-e392f59cb6f1 on hv-cinder-85427 Aug 24 08:07:52.524558 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-d1a034fc-6b8b-4977-b48c-fdfe8a4f0c62 req-5840a8ea-04f4-4884-a886-fe2ca68be7ee service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032083 Aug 24 08:07:52.525185 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 500/1001] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:08:28.321146 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=6 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:28.321908 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=87 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:28.325925 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-bfa275a3-5837-44c2-ad55-7d9b661c8e07 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:28.326423 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-bfa275a3-5837-44c2-ad55-7d9b661c8e07 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: ab2c4538-253e-44ea-8fb9-e392f59cb6f1] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:28.332269 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bfa275a3-5837-44c2-ad55-7d9b661c8e07 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:28.332792 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bfa275a3-5837-44c2-ad55-7d9b661c8e07 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:28.333232 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bfa275a3-5837-44c2-ad55-7d9b661c8e07 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:28.334451 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bfa275a3-5837-44c2-ad55-7d9b661c8e07 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:28.335003 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bfa275a3-5837-44c2-ad55-7d9b661c8e07 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:28.335430 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-bfa275a3-5837-44c2-ad55-7d9b661c8e07 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:28.359227 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-bfa275a3-5837-44c2-ad55-7d9b661c8e07 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1/ips" status: 200 len: 149 microversion: 2.1 time: 0.039877 Aug 24 08:08:28.359780 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 502/1002] 10.222.0.72 () {58 vars in 1248 bytes} [Wed Aug 24 08:08:28 2022] GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:08:30.043858 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:30.044730 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=89 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:30.048937 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-893aaf6c-4c7e-48c7-8cc9-8444b3e4da61 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b22af2f5-3801-486a-9791-426e03c8a601"}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:08:30.051344 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-893aaf6c-4c7e-48c7-8cc9-8444b3e4da61 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: ab2c4538-253e-44ea-8fb9-e392f59cb6f1] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:30.057292 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-893aaf6c-4c7e-48c7-8cc9-8444b3e4da61 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:30.057773 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-893aaf6c-4c7e-48c7-8cc9-8444b3e4da61 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:30.058213 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-893aaf6c-4c7e-48c7-8cc9-8444b3e4da61 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:30.058932 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-893aaf6c-4c7e-48c7-8cc9-8444b3e4da61 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:30.059387 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-893aaf6c-4c7e-48c7-8cc9-8444b3e4da61 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:30.059820 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-893aaf6c-4c7e-48c7-8cc9-8444b3e4da61 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:30.742386 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-893aaf6c-4c7e-48c7-8cc9-8444b3e4da61 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "POST /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.699892 Aug 24 08:08:30.742999 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 501/1003] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 24 08:08:30 2022] POST /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1/os-volume_attachments => generated 194 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:08:38.257960 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-02331cef-4146-43a1-9be2-bf4dd30f8fff tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Action: 'create', calling method: .version_select at 0x7f320cc5ce50>, body: {"keypair": {"name": "tempest-keypair-2066016831", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwvt5Yd0B9bRAY5VpbBb/4FjRQGzXaLEGC8a0g2CEHzxNmgo6Wkwr7YBaOAFhZLlY6psmVE8VrPIk3W8ivrcTqcmPq1IFgxo4fMOXlVPZRYXrOlCzGvQm88IJccdySQtQ=="}} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:08:38.274871 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.quota [None req-02331cef-4146-43a1-9be2-bf4dd30f8fff tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Getting quotas for project 2d92c8aa6d4d46538574779ae23ac398. Resources: {'key_pairs'} {{(pid=127589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:08:38.279383 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.quota [None req-02331cef-4146-43a1-9be2-bf4dd30f8fff tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Getting quotas for user 5344a1d76e764da9b08f4cb7a2bd8ca5 and project 2d92c8aa6d4d46538574779ae23ac398. Resources: {'key_pairs'} {{(pid=127589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:08:38.348733 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-02331cef-4146-43a1-9be2-bf4dd30f8fff tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.094935 Aug 24 08:08:38.349336 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 503/1004] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 24 08:08:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:08:40.543390 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-1052e2a7-5a26-4e7c-91d4-68fca58b6c50 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-14799152", "imageRef": "ccdab334-55ce-4ff5-bd97-5a424660c282", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2af2cfe3-fbb0-4b30-a7f7-b293ddfab728"}], "security_groups": [{"name": "tempest-securitygroup--1065456625"}], "key_name": "tempest-keypair-2066016831", "user_data": "}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:08:40.552527 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=2 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:40.647525 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.network.neutron [None req-1052e2a7-5a26-4e7c-91d4-68fca58b6c50 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] validate_networks() for [('2af2cfe3-fbb0-4b30-a7f7-b293ddfab728', None, None, None, None, None)] {{(pid=127590) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:08:40.694004 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:41.059516 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-1052e2a7-5a26-4e7c-91d4-68fca58b6c50 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Flavor limits 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:08:41.059974 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-1052e2a7-5a26-4e7c-91d4-68fca58b6c50 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Image limits 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:08:41.060448 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-1052e2a7-5a26-4e7c-91d4-68fca58b6c50 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Flavor pref 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:08:41.060884 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-1052e2a7-5a26-4e7c-91d4-68fca58b6c50 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Image pref 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:08:41.061301 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-1052e2a7-5a26-4e7c-91d4-68fca58b6c50 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:08:41.070792 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1052e2a7-5a26-4e7c-91d4-68fca58b6c50 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:41.071269 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1052e2a7-5a26-4e7c-91d4-68fca58b6c50 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:41.071711 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1052e2a7-5a26-4e7c-91d4-68fca58b6c50 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:41.072432 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1052e2a7-5a26-4e7c-91d4-68fca58b6c50 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:41.072908 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1052e2a7-5a26-4e7c-91d4-68fca58b6c50 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:41.073332 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-1052e2a7-5a26-4e7c-91d4-68fca58b6c50 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:41.089747 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-1052e2a7-5a26-4e7c-91d4-68fca58b6c50 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Getting quotas for project 2d92c8aa6d4d46538574779ae23ac398. Resources: {'cores', 'instances', 'ram'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:08:41.093610 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-1052e2a7-5a26-4e7c-91d4-68fca58b6c50 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Getting quotas for user 5344a1d76e764da9b08f4cb7a2bd8ca5 and project 2d92c8aa6d4d46538574779ae23ac398. Resources: {'cores', 'instances', 'ram'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:08:41.104418 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-1052e2a7-5a26-4e7c-91d4-68fca58b6c50 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Going to run 1 instances... {{(pid=127590) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:08:41.106858 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-1052e2a7-5a26-4e7c-91d4-68fca58b6c50 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccdab334-55ce-4ff5-bd97-5a424660c282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:08:41.247753 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-1052e2a7-5a26-4e7c-91d4-68fca58b6c50 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.709965 Aug 24 08:08:41.248542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 502/1005] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 24 08:08:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 08:08:41.260757 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-c18d9af0-6e78-4521-a57b-9c8d79bba893 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:41.261375 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-c18d9af0-6e78-4521-a57b-9c8d79bba893 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:41.315683 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-c18d9af0-6e78-4521-a57b-9c8d79bba893 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:41.323883 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-c18d9af0-6e78-4521-a57b-9c8d79bba893 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0" status: 200 len: 1240 microversion: 2.1 time: 0.068471 Aug 24 08:08:41.324438 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 504/1006] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:41 2022] GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:08:42.345038 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-18714472-6023-4d3e-8a1d-6e565f68da4d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:42.345727 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-18714472-6023-4d3e-8a1d-6e565f68da4d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:42.352637 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-18714472-6023-4d3e-8a1d-6e565f68da4d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:42.353294 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-18714472-6023-4d3e-8a1d-6e565f68da4d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:42.354681 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-18714472-6023-4d3e-8a1d-6e565f68da4d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:42.354681 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-18714472-6023-4d3e-8a1d-6e565f68da4d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:42.354896 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-18714472-6023-4d3e-8a1d-6e565f68da4d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:42.355229 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-18714472-6023-4d3e-8a1d-6e565f68da4d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:42.416041 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-18714472-6023-4d3e-8a1d-6e565f68da4d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:42.424002 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-18714472-6023-4d3e-8a1d-6e565f68da4d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0" status: 200 len: 1244 microversion: 2.1 time: 0.083572 Aug 24 08:08:42.424574 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 503/1007] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:42 2022] GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:43.445390 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-d4ddc713-a084-4cd5-bd2e-1d42b813cbcd tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:43.446014 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-d4ddc713-a084-4cd5-bd2e-1d42b813cbcd tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:43.452508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d4ddc713-a084-4cd5-bd2e-1d42b813cbcd tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:43.453048 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d4ddc713-a084-4cd5-bd2e-1d42b813cbcd tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:43.453489 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d4ddc713-a084-4cd5-bd2e-1d42b813cbcd tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:43.454204 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d4ddc713-a084-4cd5-bd2e-1d42b813cbcd tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:43.454662 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d4ddc713-a084-4cd5-bd2e-1d42b813cbcd tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:43.455092 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-d4ddc713-a084-4cd5-bd2e-1d42b813cbcd tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:43.517389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-d4ddc713-a084-4cd5-bd2e-1d42b813cbcd tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:43.526003 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-d4ddc713-a084-4cd5-bd2e-1d42b813cbcd tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0" status: 200 len: 1310 microversion: 2.1 time: 0.085150 Aug 24 08:08:43.526756 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 505/1008] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:43 2022] GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:44.547335 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-e6b3921f-0365-418e-ab17-20173bc0c762 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:44.547959 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-e6b3921f-0365-418e-ab17-20173bc0c762 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:44.555134 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e6b3921f-0365-418e-ab17-20173bc0c762 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:44.555627 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e6b3921f-0365-418e-ab17-20173bc0c762 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:44.556068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e6b3921f-0365-418e-ab17-20173bc0c762 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:44.556835 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e6b3921f-0365-418e-ab17-20173bc0c762 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:44.557291 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e6b3921f-0365-418e-ab17-20173bc0c762 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:44.557718 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-e6b3921f-0365-418e-ab17-20173bc0c762 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:44.692345 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-e6b3921f-0365-418e-ab17-20173bc0c762 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:44.700453 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-e6b3921f-0365-418e-ab17-20173bc0c762 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0" status: 200 len: 1366 microversion: 2.1 time: 0.157052 Aug 24 08:08:44.701064 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 504/1009] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:44 2022] GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:44.793716 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-7e77b746-d130-42e2-aa0a-63a0c29e5ff8 req-3cbbdb6b-9b6c-403e-a816-e1f0daf0ba04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0", "tag": "953cd93a-cef0-4c51-9626-bffaf2b33ae6"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:08:44.803390 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-7e77b746-d130-42e2-aa0a-63a0c29e5ff8 req-3cbbdb6b-9b6c-403e-a816-e1f0daf0ba04 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:44.808957 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-7e77b746-d130-42e2-aa0a-63a0c29e5ff8 req-3cbbdb6b-9b6c-403e-a816-e1f0daf0ba04 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:44.808957 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-7e77b746-d130-42e2-aa0a-63a0c29e5ff8 req-3cbbdb6b-9b6c-403e-a816-e1f0daf0ba04 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:44.815260 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-7e77b746-d130-42e2-aa0a-63a0c29e5ff8 req-3cbbdb6b-9b6c-403e-a816-e1f0daf0ba04 service nova] Creating event network-changed:953cd93a-cef0-4c51-9626-bffaf2b33ae6 for instance f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 on hv-cinder-85427 Aug 24 08:08:44.820377 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-7e77b746-d130-42e2-aa0a-63a0c29e5ff8 req-3cbbdb6b-9b6c-403e-a816-e1f0daf0ba04 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030389 Aug 24 08:08:44.821231 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 506/1010] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:08:45.725824 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-0c0edb0b-4cc6-4dc2-ae96-e33a15e382d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:45.726455 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-0c0edb0b-4cc6-4dc2-ae96-e33a15e382d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:45.732872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0c0edb0b-4cc6-4dc2-ae96-e33a15e382d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:45.733349 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0c0edb0b-4cc6-4dc2-ae96-e33a15e382d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:45.733783 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0c0edb0b-4cc6-4dc2-ae96-e33a15e382d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:45.734467 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0c0edb0b-4cc6-4dc2-ae96-e33a15e382d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:45.734916 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0c0edb0b-4cc6-4dc2-ae96-e33a15e382d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:45.735339 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-0c0edb0b-4cc6-4dc2-ae96-e33a15e382d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:45.862572 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-0c0edb0b-4cc6-4dc2-ae96-e33a15e382d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:45.870751 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-0c0edb0b-4cc6-4dc2-ae96-e33a15e382d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0" status: 200 len: 1366 microversion: 2.1 time: 0.149335 Aug 24 08:08:45.871319 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 505/1011] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:45 2022] GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:46.892489 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-a84cd7b1-dae8-45e1-ac75-eec242f1c10b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:46.893341 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-a84cd7b1-dae8-45e1-ac75-eec242f1c10b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:46.900616 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a84cd7b1-dae8-45e1-ac75-eec242f1c10b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:46.909017 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a84cd7b1-dae8-45e1-ac75-eec242f1c10b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:46.909017 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a84cd7b1-dae8-45e1-ac75-eec242f1c10b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:46.909017 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a84cd7b1-dae8-45e1-ac75-eec242f1c10b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:46.909017 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a84cd7b1-dae8-45e1-ac75-eec242f1c10b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:46.909407 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a84cd7b1-dae8-45e1-ac75-eec242f1c10b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:47.119529 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-a84cd7b1-dae8-45e1-ac75-eec242f1c10b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:47.127624 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-a84cd7b1-dae8-45e1-ac75-eec242f1c10b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0" status: 200 len: 1366 microversion: 2.1 time: 0.240104 Aug 24 08:08:47.128203 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 507/1012] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:46 2022] GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:48.148630 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-3867c357-d036-4709-87bf-bb554472f929 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:48.149320 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-3867c357-d036-4709-87bf-bb554472f929 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:48.155967 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3867c357-d036-4709-87bf-bb554472f929 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:48.156452 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3867c357-d036-4709-87bf-bb554472f929 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:48.156990 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3867c357-d036-4709-87bf-bb554472f929 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:48.157691 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3867c357-d036-4709-87bf-bb554472f929 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:48.158172 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3867c357-d036-4709-87bf-bb554472f929 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:48.158601 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3867c357-d036-4709-87bf-bb554472f929 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:48.286337 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-3867c357-d036-4709-87bf-bb554472f929 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:48.294274 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-3867c357-d036-4709-87bf-bb554472f929 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0" status: 200 len: 1366 microversion: 2.1 time: 0.150195 Aug 24 08:08:48.294831 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 506/1013] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:48 2022] GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:49.315454 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-047b2c04-07c6-4ff4-bfed-451c52ea78f6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:49.316199 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-047b2c04-07c6-4ff4-bfed-451c52ea78f6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:49.322871 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-047b2c04-07c6-4ff4-bfed-451c52ea78f6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:49.323358 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-047b2c04-07c6-4ff4-bfed-451c52ea78f6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:49.323824 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-047b2c04-07c6-4ff4-bfed-451c52ea78f6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:49.324529 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-047b2c04-07c6-4ff4-bfed-451c52ea78f6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:49.325017 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-047b2c04-07c6-4ff4-bfed-451c52ea78f6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:49.325524 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-047b2c04-07c6-4ff4-bfed-451c52ea78f6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:49.453836 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-047b2c04-07c6-4ff4-bfed-451c52ea78f6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:49.461960 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-047b2c04-07c6-4ff4-bfed-451c52ea78f6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0" status: 200 len: 1366 microversion: 2.1 time: 0.150426 Aug 24 08:08:49.462545 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 508/1014] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:49 2022] GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:50.482242 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-fcb3741d-18b3-43d4-aa24-09ac80cddb91 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:50.482849 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-fcb3741d-18b3-43d4-aa24-09ac80cddb91 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:50.489276 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fcb3741d-18b3-43d4-aa24-09ac80cddb91 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:50.489751 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fcb3741d-18b3-43d4-aa24-09ac80cddb91 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:50.490813 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fcb3741d-18b3-43d4-aa24-09ac80cddb91 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:50.491501 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fcb3741d-18b3-43d4-aa24-09ac80cddb91 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:50.491950 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fcb3741d-18b3-43d4-aa24-09ac80cddb91 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:50.492367 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fcb3741d-18b3-43d4-aa24-09ac80cddb91 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:50.624816 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-fcb3741d-18b3-43d4-aa24-09ac80cddb91 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:50.632903 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-fcb3741d-18b3-43d4-aa24-09ac80cddb91 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0" status: 200 len: 1366 microversion: 2.1 time: 0.154419 Aug 24 08:08:50.633471 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 507/1015] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:50 2022] GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:50.830654 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-de6fa362-3d72-4639-93f6-3e3335bc7af9 req-d33fe740-94c6-482f-b6ee-b970b71df634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0", "name": "network-vif-plugged", "status": "completed", "tag": "953cd93a-cef0-4c51-9626-bffaf2b33ae6"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:08:50.840956 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-de6fa362-3d72-4639-93f6-3e3335bc7af9 req-d33fe740-94c6-482f-b6ee-b970b71df634 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:50.841431 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-de6fa362-3d72-4639-93f6-3e3335bc7af9 req-d33fe740-94c6-482f-b6ee-b970b71df634 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:50.841857 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-de6fa362-3d72-4639-93f6-3e3335bc7af9 req-d33fe740-94c6-482f-b6ee-b970b71df634 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:50.853183 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-de6fa362-3d72-4639-93f6-3e3335bc7af9 req-d33fe740-94c6-482f-b6ee-b970b71df634 service nova] Creating event network-vif-plugged:953cd93a-cef0-4c51-9626-bffaf2b33ae6 for instance f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 on hv-cinder-85427 Aug 24 08:08:50.858092 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-de6fa362-3d72-4639-93f6-3e3335bc7af9 req-d33fe740-94c6-482f-b6ee-b970b71df634 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031165 Aug 24 08:08:50.858664 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 509/1016] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:08:51.654531 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-490e4e87-ea28-4848-8679-ef9fe305a37f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:51.655071 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-490e4e87-ea28-4848-8679-ef9fe305a37f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:51.656964 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=2 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:51.657631 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=6 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:51.663396 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-490e4e87-ea28-4848-8679-ef9fe305a37f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:51.663884 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-490e4e87-ea28-4848-8679-ef9fe305a37f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:51.664327 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-490e4e87-ea28-4848-8679-ef9fe305a37f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:51.665121 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-490e4e87-ea28-4848-8679-ef9fe305a37f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:51.665578 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-490e4e87-ea28-4848-8679-ef9fe305a37f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:51.666008 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-490e4e87-ea28-4848-8679-ef9fe305a37f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:51.793958 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-490e4e87-ea28-4848-8679-ef9fe305a37f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:51.801568 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-490e4e87-ea28-4848-8679-ef9fe305a37f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0" status: 200 len: 1366 microversion: 2.1 time: 0.151040 Aug 24 08:08:51.802121 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 508/1017] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:51 2022] GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:52.820447 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=6 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:52.825110 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-c15d0c3a-8a01-4b3d-a1a6-087980f095d4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:52.825846 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-c15d0c3a-8a01-4b3d-a1a6-087980f095d4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:52.831977 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c15d0c3a-8a01-4b3d-a1a6-087980f095d4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:52.832454 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c15d0c3a-8a01-4b3d-a1a6-087980f095d4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:52.832922 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c15d0c3a-8a01-4b3d-a1a6-087980f095d4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:52.833620 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c15d0c3a-8a01-4b3d-a1a6-087980f095d4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:52.834076 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c15d0c3a-8a01-4b3d-a1a6-087980f095d4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:52.834503 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c15d0c3a-8a01-4b3d-a1a6-087980f095d4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:52.960462 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-c15d0c3a-8a01-4b3d-a1a6-087980f095d4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:08:52.968305 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-c15d0c3a-8a01-4b3d-a1a6-087980f095d4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0" status: 200 len: 1555 microversion: 2.1 time: 0.148813 Aug 24 08:08:52.968914 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 510/1018] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:08:52 2022] GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:08:52.988122 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-4a626387-3e47-4405-8ad2-e1923b97e1cd tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:08:52.988633 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-4a626387-3e47-4405-8ad2-e1923b97e1cd tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:08:52.997179 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4a626387-3e47-4405-8ad2-e1923b97e1cd tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:52.997841 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4a626387-3e47-4405-8ad2-e1923b97e1cd tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:52.998278 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4a626387-3e47-4405-8ad2-e1923b97e1cd tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:52.999271 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4a626387-3e47-4405-8ad2-e1923b97e1cd tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:52.999715 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4a626387-3e47-4405-8ad2-e1923b97e1cd tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:53.000134 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4a626387-3e47-4405-8ad2-e1923b97e1cd tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:53.077125 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-4a626387-3e47-4405-8ad2-e1923b97e1cd tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092618 Aug 24 08:08:53.077700 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 509/1019] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 24 08:08:52 2022] GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:08:54.097548 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-05ff6a63-391b-4ed3-9486-f1def1ab2ec9 req-cda5443c-6979-4286-9f97-a0aaad68419d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0", "tag": "953cd93a-cef0-4c51-9626-bffaf2b33ae6"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:08:54.107012 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-05ff6a63-391b-4ed3-9486-f1def1ab2ec9 req-cda5443c-6979-4286-9f97-a0aaad68419d service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:08:54.107496 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-05ff6a63-391b-4ed3-9486-f1def1ab2ec9 req-cda5443c-6979-4286-9f97-a0aaad68419d service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:08:54.107933 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-05ff6a63-391b-4ed3-9486-f1def1ab2ec9 req-cda5443c-6979-4286-9f97-a0aaad68419d service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:08:54.120501 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-05ff6a63-391b-4ed3-9486-f1def1ab2ec9 req-cda5443c-6979-4286-9f97-a0aaad68419d service nova] Creating event network-changed:953cd93a-cef0-4c51-9626-bffaf2b33ae6 for instance f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 on hv-cinder-85427 Aug 24 08:08:54.125601 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-05ff6a63-391b-4ed3-9486-f1def1ab2ec9 req-cda5443c-6979-4286-9f97-a0aaad68419d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089607 Aug 24 08:08:54.126284 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 511/1020] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:09:17.220802 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:17.221713 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=42 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:17.225478 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-a30d8015-c814-4af7-a919-3879ac72d9f6 req-367e6aa0-9142-41f6-b78c-d850b6008c01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc2b21e4-3e3c-456c-88e3-8676721fb366", "tag": "1bc3f63f-39f6-4dd6-aaa6-bbbbf2911f97"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:09:17.226114 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-b6c5aa4f-d376-4e2c-a39d-994d6b6298f5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:17.226867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-b6c5aa4f-d376-4e2c-a39d-994d6b6298f5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: cc2b21e4-3e3c-456c-88e3-8676721fb366] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:17.232245 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:17.232898 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=34 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:17.233806 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b6c5aa4f-d376-4e2c-a39d-994d6b6298f5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:17.234297 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b6c5aa4f-d376-4e2c-a39d-994d6b6298f5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:17.234743 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b6c5aa4f-d376-4e2c-a39d-994d6b6298f5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:17.235441 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b6c5aa4f-d376-4e2c-a39d-994d6b6298f5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:17.235897 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b6c5aa4f-d376-4e2c-a39d-994d6b6298f5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:17.236322 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b6c5aa4f-d376-4e2c-a39d-994d6b6298f5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:17.237340 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-a30d8015-c814-4af7-a919-3879ac72d9f6 req-367e6aa0-9142-41f6-b78c-d850b6008c01 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:17.237520 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-a30d8015-c814-4af7-a919-3879ac72d9f6 req-367e6aa0-9142-41f6-b78c-d850b6008c01 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:17.237880 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-a30d8015-c814-4af7-a919-3879ac72d9f6 req-367e6aa0-9142-41f6-b78c-d850b6008c01 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:17.250270 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-a30d8015-c814-4af7-a919-3879ac72d9f6 req-367e6aa0-9142-41f6-b78c-d850b6008c01 service nova] Creating event network-changed:1bc3f63f-39f6-4dd6-aaa6-bbbbf2911f97 for instance cc2b21e4-3e3c-456c-88e3-8676721fb366 on hv-cinder-85427 Aug 24 08:09:17.255885 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-a30d8015-c814-4af7-a919-3879ac72d9f6 req-367e6aa0-9142-41f6-b78c-d850b6008c01 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034643 Aug 24 08:09:17.257416 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 512/1021] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:09:17.265450 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-b6c5aa4f-d376-4e2c-a39d-994d6b6298f5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: cc2b21e4-3e3c-456c-88e3-8676721fb366] Going to try to terminate instance {{(pid=127590) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:09:17.559235 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-b6c5aa4f-d376-4e2c-a39d-994d6b6298f5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "DELETE /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366" status: 204 len: 0 microversion: 2.1 time: 0.340799 Aug 24 08:09:17.559917 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 510/1022] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 24 08:09:17 2022] DELETE /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:09:17.569799 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-035ba92e-5de0-4729-b1b9-aa3ead633d67 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:17.571100 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-035ba92e-5de0-4729-b1b9-aa3ead633d67 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: cc2b21e4-3e3c-456c-88e3-8676721fb366] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:17.579010 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-035ba92e-5de0-4729-b1b9-aa3ead633d67 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:17.579990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-035ba92e-5de0-4729-b1b9-aa3ead633d67 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:17.579990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-035ba92e-5de0-4729-b1b9-aa3ead633d67 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:17.580631 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-035ba92e-5de0-4729-b1b9-aa3ead633d67 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:17.581258 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-035ba92e-5de0-4729-b1b9-aa3ead633d67 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:17.581679 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-035ba92e-5de0-4729-b1b9-aa3ead633d67 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:17.722397 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-035ba92e-5de0-4729-b1b9-aa3ead633d67 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:17.731472 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-035ba92e-5de0-4729-b1b9-aa3ead633d67 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366" status: 200 len: 1576 microversion: 2.1 time: 0.166838 Aug 24 08:09:17.732038 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 513/1023] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:17 2022] GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:18.754038 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-ff9fb6bc-6cf9-4322-b4d6-129bf550c4f3 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:18.754782 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-ff9fb6bc-6cf9-4322-b4d6-129bf550c4f3 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: cc2b21e4-3e3c-456c-88e3-8676721fb366] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:18.762052 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ff9fb6bc-6cf9-4322-b4d6-129bf550c4f3 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:18.762544 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ff9fb6bc-6cf9-4322-b4d6-129bf550c4f3 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:18.762984 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ff9fb6bc-6cf9-4322-b4d6-129bf550c4f3 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:18.763724 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ff9fb6bc-6cf9-4322-b4d6-129bf550c4f3 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:18.764180 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ff9fb6bc-6cf9-4322-b4d6-129bf550c4f3 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:18.764608 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ff9fb6bc-6cf9-4322-b4d6-129bf550c4f3 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:18.954718 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-ff9fb6bc-6cf9-4322-b4d6-129bf550c4f3 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:18.962486 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-ff9fb6bc-6cf9-4322-b4d6-129bf550c4f3 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366" status: 200 len: 1576 microversion: 2.1 time: 0.212960 Aug 24 08:09:18.963626 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 511/1024] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:18 2022] GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366 => generated 1576 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:09:19.723904 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-1fbc4fd3-fb97-444f-8835-09b3351424b3 req-f12c7ed0-1740-4083-897a-97adf6b18f77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc2b21e4-3e3c-456c-88e3-8676721fb366", "name": "network-vif-deleted", "tag": "1bc3f63f-39f6-4dd6-aaa6-bbbbf2911f97"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:09:19.734336 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-1fbc4fd3-fb97-444f-8835-09b3351424b3 req-f12c7ed0-1740-4083-897a-97adf6b18f77 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:19.734822 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-1fbc4fd3-fb97-444f-8835-09b3351424b3 req-f12c7ed0-1740-4083-897a-97adf6b18f77 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:19.735259 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-1fbc4fd3-fb97-444f-8835-09b3351424b3 req-f12c7ed0-1740-4083-897a-97adf6b18f77 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:19.747453 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-1fbc4fd3-fb97-444f-8835-09b3351424b3 req-f12c7ed0-1740-4083-897a-97adf6b18f77 service nova] Creating event network-vif-deleted:1bc3f63f-39f6-4dd6-aaa6-bbbbf2911f97 for instance cc2b21e4-3e3c-456c-88e3-8676721fb366 on hv-cinder-85427 Aug 24 08:09:19.753610 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-1fbc4fd3-fb97-444f-8835-09b3351424b3 req-f12c7ed0-1740-4083-897a-97adf6b18f77 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037163 Aug 24 08:09:19.754164 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 514/1025] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:09:19.984374 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-570409e6-d0e7-4c64-a5f6-54c3fc2589af tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:19.985007 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-570409e6-d0e7-4c64-a5f6-54c3fc2589af tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: cc2b21e4-3e3c-456c-88e3-8676721fb366] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:19.991760 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-570409e6-d0e7-4c64-a5f6-54c3fc2589af tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:19.992240 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-570409e6-d0e7-4c64-a5f6-54c3fc2589af tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:19.992693 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-570409e6-d0e7-4c64-a5f6-54c3fc2589af tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:19.993391 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-570409e6-d0e7-4c64-a5f6-54c3fc2589af tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:19.993839 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-570409e6-d0e7-4c64-a5f6-54c3fc2589af tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:19.994870 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-570409e6-d0e7-4c64-a5f6-54c3fc2589af tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:20.069858 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-570409e6-d0e7-4c64-a5f6-54c3fc2589af tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:20.092766 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-570409e6-d0e7-4c64-a5f6-54c3fc2589af tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366" status: 200 len: 1225 microversion: 2.1 time: 0.098341 Aug 24 08:09:20.092766 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 512/1026] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:19 2022] GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:21.100406 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-5791f61e-4670-4cad-81f9-8c1d85952b60 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:21.101129 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-5791f61e-4670-4cad-81f9-8c1d85952b60 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: cc2b21e4-3e3c-456c-88e3-8676721fb366] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:21.108323 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5791f61e-4670-4cad-81f9-8c1d85952b60 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:21.108868 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5791f61e-4670-4cad-81f9-8c1d85952b60 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:21.109310 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5791f61e-4670-4cad-81f9-8c1d85952b60 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:21.110028 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5791f61e-4670-4cad-81f9-8c1d85952b60 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:21.110488 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5791f61e-4670-4cad-81f9-8c1d85952b60 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:21.110911 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5791f61e-4670-4cad-81f9-8c1d85952b60 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:21.124002 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-5791f61e-4670-4cad-81f9-8c1d85952b60 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] HTTP exception thrown: Instance cc2b21e4-3e3c-456c-88e3-8676721fb366 could not be found. Aug 24 08:09:21.125614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-5791f61e-4670-4cad-81f9-8c1d85952b60 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Request method failure captured: Aug 24 08:09:21.125614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366 HTTP/1.1 Aug 24 08:09:21.125614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 08:09:21.125614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 08:09:21.125614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 08:09:21.125614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 08:09:21.125614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 08:09:21.125614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 08:09:21.125614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 08:09:21.125614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 08:09:21.125614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdsdPE_TENCm3veCBGHBMVkAAF-Fdbt6MSosHnKKZlOzS98CVtlx90x0G-xiPcJvD9YQyT5MfwbnSW5TA76Ocnra8rvXxxZt1pbURvj0_Gxk1bElk9M8gTuaImv_cepwfC0gtCXvUS8cowmZwtmqkZRK6CIRuNlQWRQmgi-hwQRXus4 Aug 24 08:09:21.125614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 08:09:21.125614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 08:09:21.125614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 08:09:21.125614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 08:09:21.125614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 08:09:21.125614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 08:09:21.125614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: 67da3e4c41e64947bb3e531c5b7550b6 Aug 24 08:09:21.125614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-TestVolumeBootPattern-417988494 Aug 24 08:09:21.125614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 08:09:21.125614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 08:09:21.127278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_67da3e4c41e64947bb3e531c5b7550b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/67da3e4c41e64947bb3e531c5b7550b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/67da3e4c41e64947bb3e531c5b7550b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/67da3e4c41e64947bb3e531c5b7550b6"}]}] Aug 24 08:09:21.127278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-TestVolumeBootPattern-417988494 Aug 24 08:09:21.127278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: 67da3e4c41e64947bb3e531c5b7550b6 Aug 24 08:09:21.127278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-TestVolumeBootPattern-417988494 Aug 24 08:09:21.127278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-TestVolumeBootPattern-417988494-project Aug 24 08:09:21.127278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 08:09:21.127278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 08:09:21.127278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 7a279965532e4020876954116f53d3b9 Aug 24 08:09:21.127278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-TestVolumeBootPattern-417988494-project Aug 24 08:09:21.127278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 08:09:21.127278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Instance cc2b21e4-3e3c-456c-88e3-8676721fb366 could not be found. Aug 24 08:09:21.127278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': 'cc2b21e4-3e3c-456c-88e3-8676721fb366'} Aug 24 08:09:21.128126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:09:21.128126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:09:21.128126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:09:21.128126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:09:21.128126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:09:21.128126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:09:21.128126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:09:21.128126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:09:21.128126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:09:21.128126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:09:21.128126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc2b21e4-3e3c-456c-88e3-8676721fb366 could not be found. Aug 24 08:09:21.128126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:21.128126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:09:21.128126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:21.128126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:09:21.128126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:09:21.128126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:09:21.128126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:09:21.128126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:09:21.128126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:09:21.129696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:09:21.129696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:09:21.129696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:09:21.129696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:09:21.129696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:09:21.129696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:09:21.129696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:09:21.129696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc2b21e4-3e3c-456c-88e3-8676721fb366 could not be found. Aug 24 08:09:21.129696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:21.129696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:09:21.129696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:21.129696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:09:21.129696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:09:21.129696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:09:21.129696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:09:21.129696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:09:21.129696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc2b21e4-3e3c-456c-88e3-8676721fb366 could not be found. Aug 24 08:09:21.129696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:21.131157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-5791f61e-4670-4cad-81f9-8c1d85952b60 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Returning 404 to user: Instance cc2b21e4-3e3c-456c-88e3-8676721fb366 could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:09:21.131157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-5791f61e-4670-4cad-81f9-8c1d85952b60 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366" status: 404 len: 111 microversion: 2.1 time: 0.030833 Aug 24 08:09:21.131157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 515/1027] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:21 2022] GET /compute/v2.1/servers/cc2b21e4-3e3c-456c-88e3-8676721fb366 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:09:24.703566 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-72d6828c-b0b4-4296-9150-0bd3569423d1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:24.704066 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-72d6828c-b0b4-4296-9150-0bd3569423d1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: 8779ca69-eb57-4846-9329-508c555e1aa2] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:24.707207 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-bcd42bd6-f6cd-482b-bcfb-c3ca06255a45 req-e723b899-56a7-46ae-9a0a-846012e5f721 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8779ca69-eb57-4846-9329-508c555e1aa2", "tag": "c25e4dd6-0d08-4c34-bf00-e316e15bf38b"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:09:24.713845 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-72d6828c-b0b4-4296-9150-0bd3569423d1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:24.713845 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-72d6828c-b0b4-4296-9150-0bd3569423d1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:24.713845 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-72d6828c-b0b4-4296-9150-0bd3569423d1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:24.713845 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-72d6828c-b0b4-4296-9150-0bd3569423d1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:24.714292 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-72d6828c-b0b4-4296-9150-0bd3569423d1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:24.714292 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-72d6828c-b0b4-4296-9150-0bd3569423d1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:24.718697 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-bcd42bd6-f6cd-482b-bcfb-c3ca06255a45 req-e723b899-56a7-46ae-9a0a-846012e5f721 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:24.719410 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-bcd42bd6-f6cd-482b-bcfb-c3ca06255a45 req-e723b899-56a7-46ae-9a0a-846012e5f721 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:24.719835 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-bcd42bd6-f6cd-482b-bcfb-c3ca06255a45 req-e723b899-56a7-46ae-9a0a-846012e5f721 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:24.734241 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-bcd42bd6-f6cd-482b-bcfb-c3ca06255a45 req-e723b899-56a7-46ae-9a0a-846012e5f721 service nova] Creating event network-changed:c25e4dd6-0d08-4c34-bf00-e316e15bf38b for instance 8779ca69-eb57-4846-9329-508c555e1aa2 on hv-cinder-85427 Aug 24 08:09:24.740016 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-bcd42bd6-f6cd-482b-bcfb-c3ca06255a45 req-e723b899-56a7-46ae-9a0a-846012e5f721 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037770 Aug 24 08:09:24.740514 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-72d6828c-b0b4-4296-9150-0bd3569423d1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: 8779ca69-eb57-4846-9329-508c555e1aa2] Going to try to terminate instance {{(pid=127590) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:09:24.741206 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 516/1028] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:09:25.182702 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-72d6828c-b0b4-4296-9150-0bd3569423d1 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "DELETE /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2" status: 204 len: 0 microversion: 2.1 time: 0.482380 Aug 24 08:09:25.183934 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 513/1029] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 24 08:09:24 2022] DELETE /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:09:25.194295 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-3ff82a8f-ebb1-4a1e-a417-b7a4784abab5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:25.195333 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-3ff82a8f-ebb1-4a1e-a417-b7a4784abab5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: 8779ca69-eb57-4846-9329-508c555e1aa2] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:25.202406 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3ff82a8f-ebb1-4a1e-a417-b7a4784abab5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:25.203194 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3ff82a8f-ebb1-4a1e-a417-b7a4784abab5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:25.203806 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3ff82a8f-ebb1-4a1e-a417-b7a4784abab5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:25.204578 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3ff82a8f-ebb1-4a1e-a417-b7a4784abab5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:25.205259 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3ff82a8f-ebb1-4a1e-a417-b7a4784abab5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:25.205882 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-3ff82a8f-ebb1-4a1e-a417-b7a4784abab5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:25.344298 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-3ff82a8f-ebb1-4a1e-a417-b7a4784abab5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:25.352487 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-3ff82a8f-ebb1-4a1e-a417-b7a4784abab5 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2" status: 200 len: 1576 microversion: 2.1 time: 0.162687 Aug 24 08:09:25.353729 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 517/1030] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:25 2022] GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:26.375381 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-b6a36b06-a621-4a72-a908-fa180d2df22e tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:26.376086 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-b6a36b06-a621-4a72-a908-fa180d2df22e tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: 8779ca69-eb57-4846-9329-508c555e1aa2] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:26.382751 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b6a36b06-a621-4a72-a908-fa180d2df22e tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:26.383240 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b6a36b06-a621-4a72-a908-fa180d2df22e tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:26.383680 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b6a36b06-a621-4a72-a908-fa180d2df22e tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:26.385347 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b6a36b06-a621-4a72-a908-fa180d2df22e tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:26.385547 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b6a36b06-a621-4a72-a908-fa180d2df22e tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:26.385974 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b6a36b06-a621-4a72-a908-fa180d2df22e tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:26.529605 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-b6a36b06-a621-4a72-a908-fa180d2df22e tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:26.537463 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-b6a36b06-a621-4a72-a908-fa180d2df22e tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2" status: 200 len: 1458 microversion: 2.1 time: 0.166351 Aug 24 08:09:26.538030 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 514/1031] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:26 2022] GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2 => generated 1458 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:27.258606 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-532e6048-180e-409d-b92e-e06c49ff3eab req-8dcc2482-b289-4a0d-9dbc-a783f3cfd1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8779ca69-eb57-4846-9329-508c555e1aa2", "name": "network-vif-deleted", "tag": "c25e4dd6-0d08-4c34-bf00-e316e15bf38b"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:09:27.269049 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-532e6048-180e-409d-b92e-e06c49ff3eab req-8dcc2482-b289-4a0d-9dbc-a783f3cfd1e7 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:27.271727 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-532e6048-180e-409d-b92e-e06c49ff3eab req-8dcc2482-b289-4a0d-9dbc-a783f3cfd1e7 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:27.271727 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-532e6048-180e-409d-b92e-e06c49ff3eab req-8dcc2482-b289-4a0d-9dbc-a783f3cfd1e7 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:27.281917 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-532e6048-180e-409d-b92e-e06c49ff3eab req-8dcc2482-b289-4a0d-9dbc-a783f3cfd1e7 service nova] Creating event network-vif-deleted:c25e4dd6-0d08-4c34-bf00-e316e15bf38b for instance 8779ca69-eb57-4846-9329-508c555e1aa2 on hv-cinder-85427 Aug 24 08:09:27.286692 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-532e6048-180e-409d-b92e-e06c49ff3eab req-8dcc2482-b289-4a0d-9dbc-a783f3cfd1e7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031873 Aug 24 08:09:27.287279 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 518/1032] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:09:27.559656 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-fab35304-d231-4538-a6b6-266c50ac6d86 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:27.560776 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-fab35304-d231-4538-a6b6-266c50ac6d86 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: 8779ca69-eb57-4846-9329-508c555e1aa2] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:27.567033 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fab35304-d231-4538-a6b6-266c50ac6d86 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:27.567526 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fab35304-d231-4538-a6b6-266c50ac6d86 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:27.567960 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fab35304-d231-4538-a6b6-266c50ac6d86 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:27.568682 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fab35304-d231-4538-a6b6-266c50ac6d86 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:27.569138 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fab35304-d231-4538-a6b6-266c50ac6d86 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:27.569555 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-fab35304-d231-4538-a6b6-266c50ac6d86 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:27.638224 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-fab35304-d231-4538-a6b6-266c50ac6d86 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a279965532e4020876954116f53d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67da3e4c41e64947bb3e531c5b7550b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:27.647060 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-fab35304-d231-4538-a6b6-266c50ac6d86 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2" status: 200 len: 1225 microversion: 2.1 time: 0.092018 Aug 24 08:09:27.648842 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 515/1033] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:27 2022] GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:28.672633 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-a9658ae3-1c0d-4c4c-9a32-23365c29dc9f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:28.673830 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-a9658ae3-1c0d-4c4c-9a32-23365c29dc9f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: 8779ca69-eb57-4846-9329-508c555e1aa2] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:28.680875 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a9658ae3-1c0d-4c4c-9a32-23365c29dc9f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:28.681365 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a9658ae3-1c0d-4c4c-9a32-23365c29dc9f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:28.681808 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a9658ae3-1c0d-4c4c-9a32-23365c29dc9f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:28.682517 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a9658ae3-1c0d-4c4c-9a32-23365c29dc9f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:28.682975 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a9658ae3-1c0d-4c4c-9a32-23365c29dc9f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:28.683404 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a9658ae3-1c0d-4c4c-9a32-23365c29dc9f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:28.696686 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-a9658ae3-1c0d-4c4c-9a32-23365c29dc9f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] HTTP exception thrown: Instance 8779ca69-eb57-4846-9329-508c555e1aa2 could not be found. Aug 24 08:09:28.698815 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-a9658ae3-1c0d-4c4c-9a32-23365c29dc9f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Request method failure captured: Aug 24 08:09:28.698815 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2 HTTP/1.1 Aug 24 08:09:28.698815 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 08:09:28.698815 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 08:09:28.698815 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 08:09:28.698815 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 08:09:28.698815 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 08:09:28.698815 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 08:09:28.698815 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 08:09:28.698815 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 08:09:28.698815 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdsdPE_TENCm3veCBGHBMVkAAF-Fdbt6MSosHnKKZlOzS98CVtlx90x0G-xiPcJvD9YQyT5MfwbnSW5TA76Ocnra8rvXxxZt1pbURvj0_Gxk1bElk9M8gTuaImv_cepwfC0gtCXvUS8cowmZwtmqkZRK6CIRuNlQWRQmgi-hwQRXus4 Aug 24 08:09:28.698815 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 08:09:28.698815 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 08:09:28.698815 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 08:09:28.698815 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 08:09:28.698815 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 08:09:28.698815 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 08:09:28.698815 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: 67da3e4c41e64947bb3e531c5b7550b6 Aug 24 08:09:28.698815 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-TestVolumeBootPattern-417988494 Aug 24 08:09:28.698815 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 08:09:28.698815 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 08:09:28.700425 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_67da3e4c41e64947bb3e531c5b7550b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/67da3e4c41e64947bb3e531c5b7550b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/67da3e4c41e64947bb3e531c5b7550b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/67da3e4c41e64947bb3e531c5b7550b6"}]}] Aug 24 08:09:28.700425 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-TestVolumeBootPattern-417988494 Aug 24 08:09:28.700425 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: 67da3e4c41e64947bb3e531c5b7550b6 Aug 24 08:09:28.700425 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-TestVolumeBootPattern-417988494 Aug 24 08:09:28.700425 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-TestVolumeBootPattern-417988494-project Aug 24 08:09:28.700425 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 08:09:28.700425 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 08:09:28.700425 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 7a279965532e4020876954116f53d3b9 Aug 24 08:09:28.700425 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-TestVolumeBootPattern-417988494-project Aug 24 08:09:28.700425 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 08:09:28.700425 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Instance 8779ca69-eb57-4846-9329-508c555e1aa2 could not be found. Aug 24 08:09:28.700425 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': '8779ca69-eb57-4846-9329-508c555e1aa2'} Aug 24 08:09:28.701296 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:09:28.701296 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:09:28.701296 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:09:28.701296 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:09:28.701296 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:09:28.701296 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:09:28.701296 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:09:28.701296 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:09:28.701296 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:09:28.701296 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:09:28.701296 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8779ca69-eb57-4846-9329-508c555e1aa2 could not be found. Aug 24 08:09:28.701296 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:28.701296 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:09:28.701296 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:28.701296 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:09:28.701296 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:09:28.701296 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:09:28.701296 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:09:28.701296 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:09:28.701296 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:09:28.702607 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:09:28.702607 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:09:28.702607 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:09:28.702607 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:09:28.702607 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:09:28.702607 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:09:28.702607 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:09:28.702607 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8779ca69-eb57-4846-9329-508c555e1aa2 could not be found. Aug 24 08:09:28.702607 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:28.702607 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:09:28.702607 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:28.702607 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:09:28.702607 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:09:28.702607 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:09:28.702607 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:09:28.702607 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:09:28.702607 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8779ca69-eb57-4846-9329-508c555e1aa2 could not be found. Aug 24 08:09:28.702607 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:28.703767 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-a9658ae3-1c0d-4c4c-9a32-23365c29dc9f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Returning 404 to user: Instance 8779ca69-eb57-4846-9329-508c555e1aa2 could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:09:28.703767 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-a9658ae3-1c0d-4c4c-9a32-23365c29dc9f tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2" status: 404 len: 111 microversion: 2.1 time: 0.034410 Aug 24 08:09:28.703767 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 519/1034] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:28 2022] GET /compute/v2.1/servers/8779ca69-eb57-4846-9329-508c555e1aa2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:09:28.837233 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-c29f2912-818d-4f0e-8596-b5feafe134ff tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:28.837722 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-c29f2912-818d-4f0e-8596-b5feafe134ff tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:28.844722 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c29f2912-818d-4f0e-8596-b5feafe134ff tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:28.845207 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c29f2912-818d-4f0e-8596-b5feafe134ff tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:28.845642 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c29f2912-818d-4f0e-8596-b5feafe134ff tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:28.846328 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c29f2912-818d-4f0e-8596-b5feafe134ff tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:28.846772 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c29f2912-818d-4f0e-8596-b5feafe134ff tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:28.847189 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c29f2912-818d-4f0e-8596-b5feafe134ff tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:28.870405 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-c29f2912-818d-4f0e-8596-b5feafe134ff tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0/ips" status: 200 len: 148 microversion: 2.1 time: 0.037242 Aug 24 08:09:28.870996 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 516/1035] 10.222.0.72 () {58 vars in 1248 bytes} [Wed Aug 24 08:09:28 2022] GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:09:28.882258 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-8010d971-ea2d-430d-8d8d-15e813890049 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b22af2f5-3801-486a-9791-426e03c8a601"}} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:09:28.884553 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-8010d971-ea2d-430d-8d8d-15e813890049 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:28.891062 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8010d971-ea2d-430d-8d8d-15e813890049 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:28.891563 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8010d971-ea2d-430d-8d8d-15e813890049 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:28.891990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8010d971-ea2d-430d-8d8d-15e813890049 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:28.893063 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8010d971-ea2d-430d-8d8d-15e813890049 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:28.893186 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8010d971-ea2d-430d-8d8d-15e813890049 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:28.893542 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8010d971-ea2d-430d-8d8d-15e813890049 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:28.974057 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-8010d971-ea2d-430d-8d8d-15e813890049 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] HTTP exception thrown: Invalid volume: volume b22af2f5-3801-486a-9791-426e03c8a601 is already attached to instances: ab2c4538-253e-44ea-8fb9-e392f59cb6f1 Aug 24 08:09:28.975667 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-8010d971-ea2d-430d-8d8d-15e813890049 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Request method failure captured: Aug 24 08:09:28.975667 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: POST /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0/os-volume_attachments HTTP/1.1 Aug 24 08:09:28.975667 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 08:09:28.975667 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 08:09:28.975667 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 08:09:28.975667 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 74 Aug 24 08:09:28.975667 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 08:09:28.975667 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 08:09:28.975667 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 08:09:28.975667 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 08:09:28.975667 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdxHOPiPdOZ5uR2SSeO0emctlMLk69rDmbU_apNTseI1EhtGeRqNZVBzCd4zNjmRItzEaz1cDmbEIedCWI4-AP-FzBdtrm_-Z6ZW1yFhxP0pSPtWg21hOmERjLzpQbEdNfRSjetqsS5m07LbvxlL6162IOZUIpN1pT6nBdD4o63LH-Q Aug 24 08:09:28.975667 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 08:09:28.975667 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 08:09:28.975667 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 08:09:28.975667 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 08:09:28.975667 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 08:09:28.975667 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 08:09:28.975667 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: 2d92c8aa6d4d46538574779ae23ac398 Aug 24 08:09:28.975667 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:09:28.975667 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 08:09:28.975667 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 08:09:28.977491 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d92c8aa6d4d46538574779ae23ac398"}]}] Aug 24 08:09:28.977491 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:09:28.977491 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: 2d92c8aa6d4d46538574779ae23ac398 Aug 24 08:09:28.977491 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:09:28.977491 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-AttachVolumeNegativeTest-1826831321-project Aug 24 08:09:28.977491 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 08:09:28.977491 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 08:09:28.977491 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 5344a1d76e764da9b08f4cb7a2bd8ca5 Aug 24 08:09:28.977491 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-AttachVolumeNegativeTest-1826831321-project Aug 24 08:09:28.977491 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Aug 24 08:09:28.977491 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {"volumeAttachment": {"volumeId": "b22af2f5-3801-486a-9791-426e03c8a601"}} Aug 24 08:09:28.977491 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 08:09:28.978528 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Invalid volume: volume b22af2f5-3801-486a-9791-426e03c8a601 is already attached to instances: ab2c4538-253e-44ea-8fb9-e392f59cb6f1 Aug 24 08:09:28.978528 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'server_id': 'f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0', 'body': {'volumeAttachment': {'volumeId': 'b22af2f5-3801-486a-9791-426e03c8a601'}}} Aug 24 08:09:28.978528 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:09:28.978528 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:09:28.978528 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 08:09:28.978528 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 08:09:28.978528 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 08:09:28.978528 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 08:09:28.978528 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 08:09:28.978528 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 08:09:28.978528 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 08:09:28.978528 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 08:09:28.978528 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 08:09:28.978528 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 08:09:28.978528 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b22af2f5-3801-486a-9791-426e03c8a601 is already attached to instances: ab2c4538-253e-44ea-8fb9-e392f59cb6f1 Aug 24 08:09:28.978528 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:28.978528 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:09:28.978528 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:28.978528 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:09:28.979881 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:09:28.979881 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:09:28.979881 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:09:28.979881 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:09:28.979881 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:09:28.979881 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:09:28.979881 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 08:09:28.979881 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 08:09:28.979881 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 08:09:28.979881 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 08:09:28.979881 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 08:09:28.979881 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 08:09:28.979881 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 08:09:28.979881 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 08:09:28.979881 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b22af2f5-3801-486a-9791-426e03c8a601 is already attached to instances: ab2c4538-253e-44ea-8fb9-e392f59cb6f1 Aug 24 08:09:28.979881 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:28.979881 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:09:28.979881 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:28.979881 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:09:28.979881 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:09:28.981628 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:09:28.981628 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:09:28.981628 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:09:28.981628 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b22af2f5-3801-486a-9791-426e03c8a601 is already attached to instances: ab2c4538-253e-44ea-8fb9-e392f59cb6f1 Aug 24 08:09:28.981628 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:28.981628 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-8010d971-ea2d-430d-8d8d-15e813890049 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Returning 400 to user: Invalid volume: volume b22af2f5-3801-486a-9791-426e03c8a601 is already attached to instances: ab2c4538-253e-44ea-8fb9-e392f59cb6f1 {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:09:28.981628 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-8010d971-ea2d-430d-8d8d-15e813890049 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "POST /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098890 Aug 24 08:09:28.981628 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 520/1036] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 24 08:09:28 2022] POST /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 08:09:28.985979 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-776b0650-66b3-4655-a382-056dd9407814 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:28.986319 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-776b0650-66b3-4655-a382-056dd9407814 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:28.992201 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-776b0650-66b3-4655-a382-056dd9407814 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:28.992848 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-776b0650-66b3-4655-a382-056dd9407814 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:28.993280 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-776b0650-66b3-4655-a382-056dd9407814 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:28.993965 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-776b0650-66b3-4655-a382-056dd9407814 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:28.994467 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-776b0650-66b3-4655-a382-056dd9407814 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:28.994889 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-776b0650-66b3-4655-a382-056dd9407814 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:29.023076 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-776b0650-66b3-4655-a382-056dd9407814 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0] Going to try to terminate instance {{(pid=127590) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:09:29.254877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e9c51360-540f-4201-93c6-2634a4a09e70 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:29.255376 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-e9c51360-540f-4201-93c6-2634a4a09e70 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: a2a5c24f-2c38-49f9-b39c-ee1ee740e884] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:29.262734 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e9c51360-540f-4201-93c6-2634a4a09e70 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:29.263216 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e9c51360-540f-4201-93c6-2634a4a09e70 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:29.263822 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e9c51360-540f-4201-93c6-2634a4a09e70 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:29.264530 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e9c51360-540f-4201-93c6-2634a4a09e70 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:29.265014 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e9c51360-540f-4201-93c6-2634a4a09e70 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:29.265441 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e9c51360-540f-4201-93c6-2634a4a09e70 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:29.279288 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-e9c51360-540f-4201-93c6-2634a4a09e70 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] HTTP exception thrown: Instance a2a5c24f-2c38-49f9-b39c-ee1ee740e884 could not be found. Aug 24 08:09:29.280877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e9c51360-540f-4201-93c6-2634a4a09e70 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Request method failure captured: Aug 24 08:09:29.280877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: DELETE /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884 HTTP/1.1 Aug 24 08:09:29.280877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 08:09:29.280877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 08:09:29.280877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 08:09:29.280877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 08:09:29.280877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 08:09:29.280877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 08:09:29.280877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 08:09:29.280877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 08:09:29.280877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdsdPE_TENCm3veCBGHBMVkAAF-Fdbt6MSosHnKKZlOzS98CVtlx90x0G-xiPcJvD9YQyT5MfwbnSW5TA76Ocnra8rvXxxZt1pbURvj0_Gxk1bElk9M8gTuaImv_cepwfC0gtCXvUS8cowmZwtmqkZRK6CIRuNlQWRQmgi-hwQRXus4 Aug 24 08:09:29.280877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 08:09:29.280877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 08:09:29.280877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 08:09:29.280877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 08:09:29.280877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 08:09:29.280877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 08:09:29.280877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: 67da3e4c41e64947bb3e531c5b7550b6 Aug 24 08:09:29.280877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-TestVolumeBootPattern-417988494 Aug 24 08:09:29.280877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 08:09:29.280877 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 08:09:29.282481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_67da3e4c41e64947bb3e531c5b7550b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/67da3e4c41e64947bb3e531c5b7550b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/67da3e4c41e64947bb3e531c5b7550b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/67da3e4c41e64947bb3e531c5b7550b6"}]}] Aug 24 08:09:29.282481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-TestVolumeBootPattern-417988494 Aug 24 08:09:29.282481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: 67da3e4c41e64947bb3e531c5b7550b6 Aug 24 08:09:29.282481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-TestVolumeBootPattern-417988494 Aug 24 08:09:29.282481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-TestVolumeBootPattern-417988494-project Aug 24 08:09:29.282481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 08:09:29.282481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 08:09:29.282481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 7a279965532e4020876954116f53d3b9 Aug 24 08:09:29.282481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-TestVolumeBootPattern-417988494-project Aug 24 08:09:29.282481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 08:09:29.282481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Instance a2a5c24f-2c38-49f9-b39c-ee1ee740e884 could not be found. Aug 24 08:09:29.282481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': 'a2a5c24f-2c38-49f9-b39c-ee1ee740e884'} Aug 24 08:09:29.283389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:09:29.283389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:09:29.283389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:09:29.283389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:09:29.283389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:09:29.283389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:09:29.283389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:09:29.283389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:09:29.283389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:09:29.283389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:09:29.283389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2a5c24f-2c38-49f9-b39c-ee1ee740e884 could not be found. Aug 24 08:09:29.283389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:29.283389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:09:29.283389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:29.283389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:09:29.283389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:09:29.283389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:09:29.283389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:09:29.283389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:09:29.283389 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:09:29.294818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:09:29.294818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 08:09:29.294818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 08:09:29.294818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 08:09:29.294818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 08:09:29.294818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:09:29.294818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:09:29.294818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:09:29.294818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:09:29.294818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2a5c24f-2c38-49f9-b39c-ee1ee740e884 could not be found. Aug 24 08:09:29.294818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:29.294818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:09:29.294818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:29.294818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:09:29.294818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:09:29.294818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:09:29.294818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:09:29.294818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:09:29.294818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2a5c24f-2c38-49f9-b39c-ee1ee740e884 could not be found. Aug 24 08:09:29.294818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:29.296396 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e9c51360-540f-4201-93c6-2634a4a09e70 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Returning 404 to user: Instance a2a5c24f-2c38-49f9-b39c-ee1ee740e884 could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:09:29.296396 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-e9c51360-540f-4201-93c6-2634a4a09e70 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884" status: 404 len: 111 microversion: 2.1 time: 0.031540 Aug 24 08:09:29.296396 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 521/1037] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 24 08:09:29 2022] DELETE /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:09:29.296712 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-776b0650-66b3-4655-a382-056dd9407814 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0" status: 204 len: 0 microversion: 2.1 time: 0.303831 Aug 24 08:09:29.296712 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 517/1038] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 24 08:09:28 2022] DELETE /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:09:29.302229 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-38ec49f6-27eb-4281-87e2-5e27b95de338 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:29.302845 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-38ec49f6-27eb-4281-87e2-5e27b95de338 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] [instance: a2a5c24f-2c38-49f9-b39c-ee1ee740e884] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:29.303361 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-c8c24f2d-1c67-402a-8a59-224c586c65ba tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:29.304163 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-c8c24f2d-1c67-402a-8a59-224c586c65ba tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:29.309225 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-38ec49f6-27eb-4281-87e2-5e27b95de338 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:29.312005 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-38ec49f6-27eb-4281-87e2-5e27b95de338 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:29.312005 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-38ec49f6-27eb-4281-87e2-5e27b95de338 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:29.312206 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c8c24f2d-1c67-402a-8a59-224c586c65ba tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:29.312206 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c8c24f2d-1c67-402a-8a59-224c586c65ba tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:29.312404 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-38ec49f6-27eb-4281-87e2-5e27b95de338 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:29.312500 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c8c24f2d-1c67-402a-8a59-224c586c65ba tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:29.312601 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-38ec49f6-27eb-4281-87e2-5e27b95de338 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:29.312601 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-38ec49f6-27eb-4281-87e2-5e27b95de338 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:29.312829 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c8c24f2d-1c67-402a-8a59-224c586c65ba tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:29.312829 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c8c24f2d-1c67-402a-8a59-224c586c65ba tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:29.313001 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c8c24f2d-1c67-402a-8a59-224c586c65ba tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:29.325308 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-38ec49f6-27eb-4281-87e2-5e27b95de338 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] HTTP exception thrown: Instance a2a5c24f-2c38-49f9-b39c-ee1ee740e884 could not be found. Aug 24 08:09:29.326852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-38ec49f6-27eb-4281-87e2-5e27b95de338 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Request method failure captured: Aug 24 08:09:29.326852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884 HTTP/1.1 Aug 24 08:09:29.326852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 08:09:29.326852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 08:09:29.326852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 08:09:29.326852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 08:09:29.326852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 08:09:29.326852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 08:09:29.326852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 08:09:29.326852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 08:09:29.326852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdsdPE_TENCm3veCBGHBMVkAAF-Fdbt6MSosHnKKZlOzS98CVtlx90x0G-xiPcJvD9YQyT5MfwbnSW5TA76Ocnra8rvXxxZt1pbURvj0_Gxk1bElk9M8gTuaImv_cepwfC0gtCXvUS8cowmZwtmqkZRK6CIRuNlQWRQmgi-hwQRXus4 Aug 24 08:09:29.326852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 08:09:29.326852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 08:09:29.326852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 08:09:29.326852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 08:09:29.326852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 08:09:29.326852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 08:09:29.326852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: 67da3e4c41e64947bb3e531c5b7550b6 Aug 24 08:09:29.326852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-TestVolumeBootPattern-417988494 Aug 24 08:09:29.326852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 08:09:29.326852 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 08:09:29.328340 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_67da3e4c41e64947bb3e531c5b7550b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/67da3e4c41e64947bb3e531c5b7550b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/67da3e4c41e64947bb3e531c5b7550b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/67da3e4c41e64947bb3e531c5b7550b6"}]}] Aug 24 08:09:29.328340 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-TestVolumeBootPattern-417988494 Aug 24 08:09:29.328340 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: 67da3e4c41e64947bb3e531c5b7550b6 Aug 24 08:09:29.328340 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-TestVolumeBootPattern-417988494 Aug 24 08:09:29.328340 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-TestVolumeBootPattern-417988494-project Aug 24 08:09:29.328340 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 08:09:29.328340 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 08:09:29.328340 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 7a279965532e4020876954116f53d3b9 Aug 24 08:09:29.328340 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-TestVolumeBootPattern-417988494-project Aug 24 08:09:29.328340 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 08:09:29.328340 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Instance a2a5c24f-2c38-49f9-b39c-ee1ee740e884 could not be found. Aug 24 08:09:29.328340 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': 'a2a5c24f-2c38-49f9-b39c-ee1ee740e884'} Aug 24 08:09:29.329255 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:09:29.329255 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:09:29.329255 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:09:29.329255 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:09:29.329255 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:09:29.329255 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:09:29.329255 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:09:29.329255 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:09:29.329255 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:09:29.329255 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:09:29.329255 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2a5c24f-2c38-49f9-b39c-ee1ee740e884 could not be found. Aug 24 08:09:29.329255 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:29.329255 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:09:29.329255 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:29.329255 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:09:29.329255 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:09:29.329255 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:09:29.329255 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:09:29.329255 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:09:29.329255 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:09:29.330521 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:09:29.330521 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:09:29.330521 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:09:29.330521 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:09:29.330521 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:09:29.330521 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:09:29.330521 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:09:29.330521 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2a5c24f-2c38-49f9-b39c-ee1ee740e884 could not be found. Aug 24 08:09:29.330521 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:29.330521 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:09:29.330521 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:29.330521 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:09:29.330521 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:09:29.330521 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:09:29.330521 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:09:29.330521 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:09:29.330521 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2a5c24f-2c38-49f9-b39c-ee1ee740e884 could not be found. Aug 24 08:09:29.330521 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:29.331657 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-38ec49f6-27eb-4281-87e2-5e27b95de338 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Returning 404 to user: Instance a2a5c24f-2c38-49f9-b39c-ee1ee740e884 could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:09:29.331657 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-38ec49f6-27eb-4281-87e2-5e27b95de338 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884" status: 404 len: 111 microversion: 2.1 time: 0.030064 Aug 24 08:09:29.331657 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 522/1039] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:29 2022] GET /compute/v2.1/servers/a2a5c24f-2c38-49f9-b39c-ee1ee740e884 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:09:29.443878 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-c8c24f2d-1c67-402a-8a59-224c586c65ba tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:29.452167 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-c8c24f2d-1c67-402a-8a59-224c586c65ba tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0" status: 200 len: 1679 microversion: 2.1 time: 0.153027 Aug 24 08:09:29.452815 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 518/1040] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:29 2022] GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:09:30.474780 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e430839f-e7a6-4d53-8c80-9ef28d52c5c9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:30.475399 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-e430839f-e7a6-4d53-8c80-9ef28d52c5c9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:30.482457 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e430839f-e7a6-4d53-8c80-9ef28d52c5c9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:30.482943 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e430839f-e7a6-4d53-8c80-9ef28d52c5c9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:30.483382 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e430839f-e7a6-4d53-8c80-9ef28d52c5c9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:30.484080 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e430839f-e7a6-4d53-8c80-9ef28d52c5c9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:30.484536 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e430839f-e7a6-4d53-8c80-9ef28d52c5c9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:30.484987 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e430839f-e7a6-4d53-8c80-9ef28d52c5c9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:30.617581 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e430839f-e7a6-4d53-8c80-9ef28d52c5c9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:30.625932 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-e430839f-e7a6-4d53-8c80-9ef28d52c5c9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0" status: 200 len: 1679 microversion: 2.1 time: 0.154997 Aug 24 08:09:30.626504 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 523/1041] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:30 2022] GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:30.853756 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-3505e545-776d-4070-9419-8d36912dc7b9 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] Calling method '.version_select at 0x7f320c2aa670>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:30.965833 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-3505e545-776d-4070-9419-8d36912dc7b9 tempest-TestVolumeBootPattern-417988494 tempest-TestVolumeBootPattern-417988494-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-688278176" status: 202 len: 0 microversion: 2.1 time: 0.120441 Aug 24 08:09:30.966391 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 519/1042] 10.222.0.72 () {58 vars in 1260 bytes} [Wed Aug 24 08:09:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-688278176 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:09:31.647594 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-6fb8224e-99b7-45b4-9c54-54da5ee86c8f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:31.648388 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-6fb8224e-99b7-45b4-9c54-54da5ee86c8f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:31.655691 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6fb8224e-99b7-45b4-9c54-54da5ee86c8f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:31.656338 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6fb8224e-99b7-45b4-9c54-54da5ee86c8f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:31.656907 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6fb8224e-99b7-45b4-9c54-54da5ee86c8f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:31.657744 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6fb8224e-99b7-45b4-9c54-54da5ee86c8f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:31.658306 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6fb8224e-99b7-45b4-9c54-54da5ee86c8f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:31.658837 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6fb8224e-99b7-45b4-9c54-54da5ee86c8f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:31.743627 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-6fb8224e-99b7-45b4-9c54-54da5ee86c8f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:31.765897 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-0f0f2ac8-9b4e-4861-bd58-d0f5b8fab12f req-88dba270-0bd7-4527-b8f6-ef7d908445f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0", "name": "network-vif-deleted", "tag": "953cd93a-cef0-4c51-9626-bffaf2b33ae6"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:09:31.779491 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-6fb8224e-99b7-45b4-9c54-54da5ee86c8f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0" status: 200 len: 1611 microversion: 2.1 time: 0.135901 Aug 24 08:09:31.792799 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-0f0f2ac8-9b4e-4861-bd58-d0f5b8fab12f req-88dba270-0bd7-4527-b8f6-ef7d908445f2 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:31.792799 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-0f0f2ac8-9b4e-4861-bd58-d0f5b8fab12f req-88dba270-0bd7-4527-b8f6-ef7d908445f2 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:31.792799 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-0f0f2ac8-9b4e-4861-bd58-d0f5b8fab12f req-88dba270-0bd7-4527-b8f6-ef7d908445f2 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:31.795889 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 524/1043] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:31 2022] GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 => generated 1611 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:31.800234 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-0f0f2ac8-9b4e-4861-bd58-d0f5b8fab12f req-88dba270-0bd7-4527-b8f6-ef7d908445f2 service nova] Creating event network-vif-deleted:953cd93a-cef0-4c51-9626-bffaf2b33ae6 for instance f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 on hv-cinder-85427 Aug 24 08:09:31.805921 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-0f0f2ac8-9b4e-4861-bd58-d0f5b8fab12f req-88dba270-0bd7-4527-b8f6-ef7d908445f2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051475 Aug 24 08:09:31.806375 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 520/1044] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:09:32.805451 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-f03d0220-92b5-4b64-a0d1-a34b5311e0d9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:32.806329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-f03d0220-92b5-4b64-a0d1-a34b5311e0d9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:32.813646 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f03d0220-92b5-4b64-a0d1-a34b5311e0d9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:32.814139 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f03d0220-92b5-4b64-a0d1-a34b5311e0d9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:32.814583 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f03d0220-92b5-4b64-a0d1-a34b5311e0d9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:32.815301 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f03d0220-92b5-4b64-a0d1-a34b5311e0d9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:32.815909 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f03d0220-92b5-4b64-a0d1-a34b5311e0d9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:32.816348 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f03d0220-92b5-4b64-a0d1-a34b5311e0d9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:32.831653 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-f03d0220-92b5-4b64-a0d1-a34b5311e0d9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] HTTP exception thrown: Instance f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 could not be found. Aug 24 08:09:32.833254 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-f03d0220-92b5-4b64-a0d1-a34b5311e0d9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Request method failure captured: Aug 24 08:09:32.833254 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 HTTP/1.1 Aug 24 08:09:32.833254 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 08:09:32.833254 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 08:09:32.833254 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 08:09:32.833254 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 08:09:32.833254 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 08:09:32.833254 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 08:09:32.833254 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 08:09:32.833254 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 08:09:32.833254 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdxHOPiPdOZ5uR2SSeO0emctlMLk69rDmbU_apNTseI1EhtGeRqNZVBzCd4zNjmRItzEaz1cDmbEIedCWI4-AP-FzBdtrm_-Z6ZW1yFhxP0pSPtWg21hOmERjLzpQbEdNfRSjetqsS5m07LbvxlL6162IOZUIpN1pT6nBdD4o63LH-Q Aug 24 08:09:32.833254 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 08:09:32.833254 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 08:09:32.833254 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 08:09:32.833254 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 08:09:32.833254 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 08:09:32.833254 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 08:09:32.833254 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: 2d92c8aa6d4d46538574779ae23ac398 Aug 24 08:09:32.833254 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:09:32.833254 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 08:09:32.833254 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 08:09:32.834709 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d92c8aa6d4d46538574779ae23ac398"}]}] Aug 24 08:09:32.834709 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:09:32.834709 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: 2d92c8aa6d4d46538574779ae23ac398 Aug 24 08:09:32.834709 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:09:32.834709 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-AttachVolumeNegativeTest-1826831321-project Aug 24 08:09:32.834709 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 08:09:32.834709 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 08:09:32.834709 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 5344a1d76e764da9b08f4cb7a2bd8ca5 Aug 24 08:09:32.834709 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-AttachVolumeNegativeTest-1826831321-project Aug 24 08:09:32.834709 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 08:09:32.834709 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Instance f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 could not be found. Aug 24 08:09:32.834709 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': 'f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0'} Aug 24 08:09:32.835592 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:09:32.835592 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:09:32.835592 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:09:32.835592 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:09:32.835592 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:09:32.835592 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:09:32.835592 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:09:32.835592 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:09:32.835592 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:09:32.835592 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:09:32.835592 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 could not be found. Aug 24 08:09:32.835592 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:32.835592 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:09:32.835592 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:32.835592 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:09:32.835592 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:09:32.835592 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:09:32.835592 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:09:32.835592 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:09:32.835592 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:09:32.837449 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:09:32.837449 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:09:32.837449 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:09:32.837449 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:09:32.837449 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:09:32.837449 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:09:32.837449 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:09:32.837449 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 could not be found. Aug 24 08:09:32.837449 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:32.837449 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:09:32.837449 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:32.837449 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:09:32.837449 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:09:32.837449 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:09:32.837449 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:09:32.837449 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:09:32.837449 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 could not be found. Aug 24 08:09:32.837449 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:09:32.840537 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-f03d0220-92b5-4b64-a0d1-a34b5311e0d9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Returning 404 to user: Instance f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:09:32.840537 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-f03d0220-92b5-4b64-a0d1-a34b5311e0d9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0" status: 404 len: 111 microversion: 2.1 time: 0.033184 Aug 24 08:09:32.844204 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 525/1045] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:32 2022] GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:09:32.846215 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-47c6aa82-93fd-4fa6-862d-7869a36ae342 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '.version_select at 0x7f320c2f11f0>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:32.990440 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-47c6aa82-93fd-4fa6-862d-7869a36ae342 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2066016831" status: 202 len: 0 microversion: 2.1 time: 0.149369 Aug 24 08:09:32.991824 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 521/1046] 10.222.0.72 () {58 vars in 1221 bytes} [Wed Aug 24 08:09:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2066016831 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:09:34.366299 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-9f45dc6a-b804-4c8c-a40c-006ca3d3a0e5 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:34.366944 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-9f45dc6a-b804-4c8c-a40c-006ca3d3a0e5 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: ab2c4538-253e-44ea-8fb9-e392f59cb6f1] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:34.373918 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9f45dc6a-b804-4c8c-a40c-006ca3d3a0e5 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:34.374406 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9f45dc6a-b804-4c8c-a40c-006ca3d3a0e5 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:34.374847 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9f45dc6a-b804-4c8c-a40c-006ca3d3a0e5 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:34.375549 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9f45dc6a-b804-4c8c-a40c-006ca3d3a0e5 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:34.376028 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9f45dc6a-b804-4c8c-a40c-006ca3d3a0e5 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:34.376461 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9f45dc6a-b804-4c8c-a40c-006ca3d3a0e5 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:34.468359 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.objects.instance [None req-9f45dc6a-b804-4c8c-a40c-006ca3d3a0e5 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lazy-loading 'services' on Instance uuid ab2c4538-253e-44ea-8fb9-e392f59cb6f1 {{(pid=127589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:09:34.677447 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-9f45dc6a-b804-4c8c-a40c-006ca3d3a0e5 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "DELETE /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1/os-volume_attachments/b22af2f5-3801-486a-9791-426e03c8a601" status: 202 len: 0 microversion: 2.1 time: 0.314948 Aug 24 08:09:34.682083 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 526/1047] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 24 08:09:34 2022] DELETE /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1/os-volume_attachments/b22af2f5-3801-486a-9791-426e03c8a601 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:09:34.691145 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-8ecd965b-58e7-47e9-9f81-d454504e0bba tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:34.700672 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-8ecd965b-58e7-47e9-9f81-d454504e0bba tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: ab2c4538-253e-44ea-8fb9-e392f59cb6f1] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:34.708084 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8ecd965b-58e7-47e9-9f81-d454504e0bba tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:34.708568 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8ecd965b-58e7-47e9-9f81-d454504e0bba tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:34.709040 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8ecd965b-58e7-47e9-9f81-d454504e0bba tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:34.709748 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8ecd965b-58e7-47e9-9f81-d454504e0bba tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:34.710207 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8ecd965b-58e7-47e9-9f81-d454504e0bba tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:34.710635 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8ecd965b-58e7-47e9-9f81-d454504e0bba tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:34.743963 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-8ecd965b-58e7-47e9-9f81-d454504e0bba tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060397 Aug 24 08:09:34.744597 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 522/1048] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 24 08:09:34 2022] GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:09:35.757262 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-71699555-7c46-4276-b8fc-645e9a402e86 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:35.759632 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-71699555-7c46-4276-b8fc-645e9a402e86 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: ab2c4538-253e-44ea-8fb9-e392f59cb6f1] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:35.766262 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-71699555-7c46-4276-b8fc-645e9a402e86 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:35.766749 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-71699555-7c46-4276-b8fc-645e9a402e86 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:35.767185 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-71699555-7c46-4276-b8fc-645e9a402e86 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:35.767894 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-71699555-7c46-4276-b8fc-645e9a402e86 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:35.768344 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-71699555-7c46-4276-b8fc-645e9a402e86 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:35.768797 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-71699555-7c46-4276-b8fc-645e9a402e86 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:35.799271 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-71699555-7c46-4276-b8fc-645e9a402e86 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046400 Aug 24 08:09:35.799844 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 527/1049] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 24 08:09:35 2022] GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 08:09:35.863386 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-da4c661b-c2f1-4670-9209-39c2d78bb8e6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:35.863940 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-da4c661b-c2f1-4670-9209-39c2d78bb8e6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: ab2c4538-253e-44ea-8fb9-e392f59cb6f1] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:35.870482 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-da4c661b-c2f1-4670-9209-39c2d78bb8e6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:35.870988 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-da4c661b-c2f1-4670-9209-39c2d78bb8e6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:35.871423 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-da4c661b-c2f1-4670-9209-39c2d78bb8e6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:35.872115 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-da4c661b-c2f1-4670-9209-39c2d78bb8e6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:35.872563 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-da4c661b-c2f1-4670-9209-39c2d78bb8e6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:35.873010 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-da4c661b-c2f1-4670-9209-39c2d78bb8e6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:35.898379 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-da4c661b-c2f1-4670-9209-39c2d78bb8e6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: ab2c4538-253e-44ea-8fb9-e392f59cb6f1] Going to try to terminate instance {{(pid=127590) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:09:35.925655 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:36.243927 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-da4c661b-c2f1-4670-9209-39c2d78bb8e6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "DELETE /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1" status: 204 len: 0 microversion: 2.1 time: 0.384077 Aug 24 08:09:36.248145 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 523/1050] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 24 08:09:35 2022] DELETE /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:09:36.254127 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-5321b619-a8b7-4956-891c-72104c421007 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:36.254783 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-5321b619-a8b7-4956-891c-72104c421007 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: ab2c4538-253e-44ea-8fb9-e392f59cb6f1] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:36.262914 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5321b619-a8b7-4956-891c-72104c421007 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:36.263455 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5321b619-a8b7-4956-891c-72104c421007 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:36.264099 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5321b619-a8b7-4956-891c-72104c421007 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:36.264711 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5321b619-a8b7-4956-891c-72104c421007 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:36.265180 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5321b619-a8b7-4956-891c-72104c421007 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:36.265601 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-5321b619-a8b7-4956-891c-72104c421007 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:36.413202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-5321b619-a8b7-4956-891c-72104c421007 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:36.421666 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-5321b619-a8b7-4956-891c-72104c421007 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1" status: 200 len: 1679 microversion: 2.1 time: 0.172003 Aug 24 08:09:36.422258 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 528/1051] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:36 2022] GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:37.444381 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-651434b4-89dd-48a3-88ad-c7d7cc6341fb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:37.445094 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-651434b4-89dd-48a3-88ad-c7d7cc6341fb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: ab2c4538-253e-44ea-8fb9-e392f59cb6f1] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:37.452064 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-651434b4-89dd-48a3-88ad-c7d7cc6341fb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:37.452547 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-651434b4-89dd-48a3-88ad-c7d7cc6341fb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:37.453014 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-651434b4-89dd-48a3-88ad-c7d7cc6341fb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:37.453704 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-651434b4-89dd-48a3-88ad-c7d7cc6341fb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:37.455592 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-651434b4-89dd-48a3-88ad-c7d7cc6341fb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:37.455592 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-651434b4-89dd-48a3-88ad-c7d7cc6341fb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:37.743405 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-651434b4-89dd-48a3-88ad-c7d7cc6341fb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:37.760682 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-651434b4-89dd-48a3-88ad-c7d7cc6341fb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1" status: 200 len: 1679 microversion: 2.1 time: 0.320499 Aug 24 08:09:37.761286 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 524/1052] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:37 2022] GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1 => generated 1679 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:38.782329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-0224b83f-bcd4-4f4f-bd3d-f2b686ce15d0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:38.788336 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-0224b83f-bcd4-4f4f-bd3d-f2b686ce15d0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: ab2c4538-253e-44ea-8fb9-e392f59cb6f1] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:38.792403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-6a4a3216-d6d7-4f0f-bf09-30cc87ee2774 req-8524bec6-bf47-4821-9f2f-01ff8b0a0cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab2c4538-253e-44ea-8fb9-e392f59cb6f1", "name": "network-vif-deleted", "tag": "8853b076-349a-4e2c-a58b-48611309257f"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:09:38.811228 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0224b83f-bcd4-4f4f-bd3d-f2b686ce15d0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:38.814021 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-6a4a3216-d6d7-4f0f-bf09-30cc87ee2774 req-8524bec6-bf47-4821-9f2f-01ff8b0a0cc0 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:38.814496 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-6a4a3216-d6d7-4f0f-bf09-30cc87ee2774 req-8524bec6-bf47-4821-9f2f-01ff8b0a0cc0 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:38.814920 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-6a4a3216-d6d7-4f0f-bf09-30cc87ee2774 req-8524bec6-bf47-4821-9f2f-01ff8b0a0cc0 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:38.817892 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0224b83f-bcd4-4f4f-bd3d-f2b686ce15d0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:38.822851 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0224b83f-bcd4-4f4f-bd3d-f2b686ce15d0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:38.822851 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0224b83f-bcd4-4f4f-bd3d-f2b686ce15d0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:38.822851 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0224b83f-bcd4-4f4f-bd3d-f2b686ce15d0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:38.822851 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0224b83f-bcd4-4f4f-bd3d-f2b686ce15d0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:38.859385 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-6a4a3216-d6d7-4f0f-bf09-30cc87ee2774 req-8524bec6-bf47-4821-9f2f-01ff8b0a0cc0 service nova] Creating event network-vif-deleted:8853b076-349a-4e2c-a58b-48611309257f for instance ab2c4538-253e-44ea-8fb9-e392f59cb6f1 on hv-cinder-85427 Aug 24 08:09:38.866234 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-6a4a3216-d6d7-4f0f-bf09-30cc87ee2774 req-8524bec6-bf47-4821-9f2f-01ff8b0a0cc0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077367 Aug 24 08:09:38.869811 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 525/1053] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:09:38.935573 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-0224b83f-bcd4-4f4f-bd3d-f2b686ce15d0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:38.945271 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-0224b83f-bcd4-4f4f-bd3d-f2b686ce15d0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1" status: 200 len: 1612 microversion: 2.1 time: 0.166584 Aug 24 08:09:38.949566 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 529/1054] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:38 2022] GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1 => generated 1612 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:39.967968 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-525bd359-ffc1-4b41-bb8e-8074027cdb51 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:39.969654 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-525bd359-ffc1-4b41-bb8e-8074027cdb51 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: ab2c4538-253e-44ea-8fb9-e392f59cb6f1] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:39.975630 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-525bd359-ffc1-4b41-bb8e-8074027cdb51 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:39.976184 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-525bd359-ffc1-4b41-bb8e-8074027cdb51 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:39.976551 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-525bd359-ffc1-4b41-bb8e-8074027cdb51 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:39.977286 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-525bd359-ffc1-4b41-bb8e-8074027cdb51 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:39.977742 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-525bd359-ffc1-4b41-bb8e-8074027cdb51 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:39.978328 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-525bd359-ffc1-4b41-bb8e-8074027cdb51 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:39.991768 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.wsgi [None req-525bd359-ffc1-4b41-bb8e-8074027cdb51 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] HTTP exception thrown: Instance ab2c4538-253e-44ea-8fb9-e392f59cb6f1 could not be found. Aug 24 08:09:39.993462 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-525bd359-ffc1-4b41-bb8e-8074027cdb51 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Request method failure captured: Aug 24 08:09:39.993462 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: request: GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1 HTTP/1.1 Aug 24 08:09:39.993462 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept: application/json Aug 24 08:09:39.993462 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept-Encoding: identity Aug 24 08:09:39.993462 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Connection: close Aug 24 08:09:39.993462 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Length: 0 Aug 24 08:09:39.993462 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Type: application/json Aug 24 08:09:39.993462 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Host: 10.222.0.72 Aug 24 08:09:39.993462 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Openstack-System-Scope: None Aug 24 08:09:39.993462 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: User-Agent: python-urllib3/1.26.11 Aug 24 08:09:39.993462 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Auth-Token: gAAAAABjBdxHOPiPdOZ5uR2SSeO0emctlMLk69rDmbU_apNTseI1EhtGeRqNZVBzCd4zNjmRItzEaz1cDmbEIedCWI4-AP-FzBdtrm_-Z6ZW1yFhxP0pSPtWg21hOmERjLzpQbEdNfRSjetqsS5m07LbvxlL6162IOZUIpN1pT6nBdD4o63LH-Q Aug 24 08:09:39.993462 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Id: None Aug 24 08:09:39.993462 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Name: None Aug 24 08:09:39.993462 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Identity-Status: Confirmed Aug 24 08:09:39.993462 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Is-Admin-Project: True Aug 24 08:09:39.993462 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Id: default Aug 24 08:09:39.993462 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Name: Default Aug 24 08:09:39.993462 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Id: 2d92c8aa6d4d46538574779ae23ac398 Aug 24 08:09:39.993462 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Name: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:09:39.993462 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Role: reader,member Aug 24 08:09:39.993462 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Roles: reader,member Aug 24 08:09:39.995092 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d92c8aa6d4d46538574779ae23ac398"}]}] Aug 24 08:09:39.995092 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:09:39.995092 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Id: 2d92c8aa6d4d46538574779ae23ac398 Aug 24 08:09:39.995092 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:09:39.995092 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User: tempest-AttachVolumeNegativeTest-1826831321-project Aug 24 08:09:39.995092 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Id: default Aug 24 08:09:39.995092 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Name: Default Aug 24 08:09:39.995092 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Id: 5344a1d76e764da9b08f4cb7a2bd8ca5 Aug 24 08:09:39.995092 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Name: tempest-AttachVolumeNegativeTest-1826831321-project Aug 24 08:09:39.995092 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: method: > Aug 24 08:09:39.995092 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: exception: Instance ab2c4538-253e-44ea-8fb9-e392f59cb6f1 could not be found. Aug 24 08:09:39.995092 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: action_args: {'id': 'ab2c4538-253e-44ea-8fb9-e392f59cb6f1'} Aug 24 08:09:39.996068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:09:39.996068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:09:39.996068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:09:39.996068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:09:39.996068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:09:39.996068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:09:39.996068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:09:39.996068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:09:39.996068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:09:39.996068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:09:39.996068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab2c4538-253e-44ea-8fb9-e392f59cb6f1 could not be found. Aug 24 08:09:39.996068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:09:39.996068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:09:39.996068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:09:39.996068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:09:39.996068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:09:39.996068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:09:39.996068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:09:39.996068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:09:39.996068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:09:39.997478 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:09:39.997478 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:09:39.997478 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:09:39.997478 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:09:39.997478 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:09:39.997478 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:09:39.997478 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:09:39.997478 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab2c4538-253e-44ea-8fb9-e392f59cb6f1 could not be found. Aug 24 08:09:39.997478 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:09:39.997478 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:09:39.997478 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:09:39.997478 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:09:39.997478 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:09:39.997478 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:09:39.997478 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:09:39.997478 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:09:39.997478 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab2c4538-253e-44ea-8fb9-e392f59cb6f1 could not be found. Aug 24 08:09:39.997478 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:09:39.999110 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-525bd359-ffc1-4b41-bb8e-8074027cdb51 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Returning 404 to user: Instance ab2c4538-253e-44ea-8fb9-e392f59cb6f1 could not be found. {{(pid=127590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:09:39.999110 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-525bd359-ffc1-4b41-bb8e-8074027cdb51 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1" status: 404 len: 111 microversion: 2.1 time: 0.032270 Aug 24 08:09:39.999110 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 526/1055] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:39 2022] GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:09:40.004690 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e13fa200-9610-415c-b7db-f59810db3b38 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '.version_select at 0x7f320cb4e9d0>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:40.067539 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-e13fa200-9610-415c-b7db-f59810db3b38 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-18046273" status: 202 len: 0 microversion: 2.1 time: 0.067153 Aug 24 08:09:40.068343 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 530/1056] 10.222.0.72 () {58 vars in 1215 bytes} [Wed Aug 24 08:09:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-18046273 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:09:40.851562 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-cf6a6656-0c79-4223-b2e8-3c4e8910fe58 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Action: 'create', calling method: .version_select at 0x7f3210aacdc0>, body: {"keypair": {"name": "tempest-keypair-423132443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMa90qrWSvLempf3Jko/f67v8h2ewIxF/PDOO/yu3DCyLZTiRqejLcv2oAB9Zb9oY3PJ29p1igpH3kGJ5eKRSNOsJ4a2gCDA6L56ybjFy9T5YzjfykQR/HkPrDfjeJlRnw=="}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:09:40.868265 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-cf6a6656-0c79-4223-b2e8-3c4e8910fe58 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Getting quotas for project 2d92c8aa6d4d46538574779ae23ac398. Resources: {'key_pairs'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:09:40.873489 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-cf6a6656-0c79-4223-b2e8-3c4e8910fe58 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Getting quotas for user 5344a1d76e764da9b08f4cb7a2bd8ca5 and project 2d92c8aa6d4d46538574779ae23ac398. Resources: {'key_pairs'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:09:41.032978 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-cf6a6656-0c79-4223-b2e8-3c4e8910fe58 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.185269 Aug 24 08:09:41.033615 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 527/1057] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 24 08:09:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:09:43.347362 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-368ff495-5952-48a5-874e-e40290bb1a08 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1268373424", "imageRef": "ccdab334-55ce-4ff5-bd97-5a424660c282", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2af2cfe3-fbb0-4b30-a7f7-b293ddfab728"}], "security_groups": [{"name": "tempest-securitygroup--1768876173"}], "key_name": "tempest-keypair-423132443", "user_data": "}} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:09:43.461624 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.network.neutron [None req-368ff495-5952-48a5-874e-e40290bb1a08 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] validate_networks() for [('2af2cfe3-fbb0-4b30-a7f7-b293ddfab728', None, None, None, None, None)] {{(pid=127589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:09:43.927187 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-368ff495-5952-48a5-874e-e40290bb1a08 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Flavor limits 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:09:43.927615 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-368ff495-5952-48a5-874e-e40290bb1a08 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Image limits 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:09:43.928126 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-368ff495-5952-48a5-874e-e40290bb1a08 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Flavor pref 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:09:43.928505 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-368ff495-5952-48a5-874e-e40290bb1a08 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Image pref 0:0:0 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:09:43.928942 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.virt.hardware [None req-368ff495-5952-48a5-874e-e40290bb1a08 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:09:43.937996 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-368ff495-5952-48a5-874e-e40290bb1a08 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:43.938491 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-368ff495-5952-48a5-874e-e40290bb1a08 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:43.939628 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-368ff495-5952-48a5-874e-e40290bb1a08 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:43.940641 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-368ff495-5952-48a5-874e-e40290bb1a08 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:43.941511 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-368ff495-5952-48a5-874e-e40290bb1a08 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:43.942281 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-368ff495-5952-48a5-874e-e40290bb1a08 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:43.961021 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.quota [None req-368ff495-5952-48a5-874e-e40290bb1a08 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Getting quotas for project 2d92c8aa6d4d46538574779ae23ac398. Resources: {'cores', 'instances', 'ram'} {{(pid=127589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:09:43.965831 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.quota [None req-368ff495-5952-48a5-874e-e40290bb1a08 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Getting quotas for user 5344a1d76e764da9b08f4cb7a2bd8ca5 and project 2d92c8aa6d4d46538574779ae23ac398. Resources: {'cores', 'instances', 'ram'} {{(pid=127589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:09:43.976823 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-368ff495-5952-48a5-874e-e40290bb1a08 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Going to run 1 instances... {{(pid=127589) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:09:43.979164 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-368ff495-5952-48a5-874e-e40290bb1a08 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccdab334-55ce-4ff5-bd97-5a424660c282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:09:44.158448 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR oslo.messaging._drivers.impl_rabbit [None req-368ff495-5952-48a5-874e-e40290bb1a08 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [39d196d1-2faa-4da6-9fa1-7c9d09effdff] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 08:09:45.165821 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO oslo.messaging._drivers.impl_rabbit [None req-368ff495-5952-48a5-874e-e40290bb1a08 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [39d196d1-2faa-4da6-9fa1-7c9d09effdff] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 35260. Aug 24 08:09:45.170812 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-368ff495-5952-48a5-874e-e40290bb1a08 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.827774 Aug 24 08:09:45.171463 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 531/1058] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 24 08:09:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 1829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 08:09:45.183327 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-9835a337-56aa-4c3f-8740-ffa7238025e6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:45.183966 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-9835a337-56aa-4c3f-8740-ffa7238025e6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:45.237866 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9835a337-56aa-4c3f-8740-ffa7238025e6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:45.244869 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-9835a337-56aa-4c3f-8740-ffa7238025e6 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7" status: 200 len: 1241 microversion: 2.1 time: 0.066046 Aug 24 08:09:45.248822 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 528/1059] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:45 2022] GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:46.274327 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-121fbdbc-78ea-4177-9986-27f548e3bdd3 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:46.275649 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-121fbdbc-78ea-4177-9986-27f548e3bdd3 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:46.328378 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-121fbdbc-78ea-4177-9986-27f548e3bdd3 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:46.335186 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-121fbdbc-78ea-4177-9986-27f548e3bdd3 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7" status: 200 len: 1241 microversion: 2.1 time: 0.065516 Aug 24 08:09:46.335738 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 532/1060] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:46 2022] GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:47.355644 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-d25eee85-2ba6-41ba-b3e8-b234f984e39a tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:47.356247 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-d25eee85-2ba6-41ba-b3e8-b234f984e39a tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:47.409971 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-d25eee85-2ba6-41ba-b3e8-b234f984e39a tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:47.417752 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-d25eee85-2ba6-41ba-b3e8-b234f984e39a tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7" status: 200 len: 1241 microversion: 2.1 time: 0.066483 Aug 24 08:09:47.418347 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 529/1061] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:47 2022] GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:48.438230 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-f062cc16-2b30-4e7d-a4a8-0d1333677f03 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:48.438842 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-f062cc16-2b30-4e7d-a4a8-0d1333677f03 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:48.441276 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:48.490584 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-f062cc16-2b30-4e7d-a4a8-0d1333677f03 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:48.498181 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-f062cc16-2b30-4e7d-a4a8-0d1333677f03 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7" status: 200 len: 1241 microversion: 2.1 time: 0.063882 Aug 24 08:09:48.498749 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 533/1062] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:48 2022] GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:49.518974 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-aae0398a-7bed-4f33-bb80-5b3a700d09d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:49.519626 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-aae0398a-7bed-4f33-bb80-5b3a700d09d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:49.522458 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=4,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:49.528834 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-aae0398a-7bed-4f33-bb80-5b3a700d09d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:49.529319 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-aae0398a-7bed-4f33-bb80-5b3a700d09d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:49.529759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-aae0398a-7bed-4f33-bb80-5b3a700d09d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:49.530466 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-aae0398a-7bed-4f33-bb80-5b3a700d09d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:49.530913 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-aae0398a-7bed-4f33-bb80-5b3a700d09d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:49.531370 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-aae0398a-7bed-4f33-bb80-5b3a700d09d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:49.596563 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-aae0398a-7bed-4f33-bb80-5b3a700d09d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:49.604847 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-aae0398a-7bed-4f33-bb80-5b3a700d09d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7" status: 200 len: 1245 microversion: 2.1 time: 0.089727 Aug 24 08:09:49.605403 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 530/1063] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:49 2022] GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7 => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:50.625732 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-61f4963e-48cb-4581-8dad-de53e9ef1e5b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:50.626484 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-61f4963e-48cb-4581-8dad-de53e9ef1e5b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:50.635318 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-61f4963e-48cb-4581-8dad-de53e9ef1e5b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:50.635800 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-61f4963e-48cb-4581-8dad-de53e9ef1e5b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:50.636234 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-61f4963e-48cb-4581-8dad-de53e9ef1e5b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:50.636956 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-61f4963e-48cb-4581-8dad-de53e9ef1e5b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:50.637450 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-61f4963e-48cb-4581-8dad-de53e9ef1e5b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:50.637870 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-61f4963e-48cb-4581-8dad-de53e9ef1e5b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:50.642009 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=1 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:50.703013 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-61f4963e-48cb-4581-8dad-de53e9ef1e5b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:50.711737 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-61f4963e-48cb-4581-8dad-de53e9ef1e5b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7" status: 200 len: 1237 microversion: 2.1 time: 0.089882 Aug 24 08:09:50.712363 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 534/1064] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:50 2022] GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7 => generated 1237 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:51.736450 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-d95e801a-7ca0-48b8-8e78-c7bf9a588341 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:51.737182 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-d95e801a-7ca0-48b8-8e78-c7bf9a588341 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:51.744207 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d95e801a-7ca0-48b8-8e78-c7bf9a588341 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:51.745611 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d95e801a-7ca0-48b8-8e78-c7bf9a588341 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:51.745611 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d95e801a-7ca0-48b8-8e78-c7bf9a588341 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:51.745887 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d95e801a-7ca0-48b8-8e78-c7bf9a588341 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:51.746439 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d95e801a-7ca0-48b8-8e78-c7bf9a588341 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:51.746919 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d95e801a-7ca0-48b8-8e78-c7bf9a588341 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:51.810706 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-d95e801a-7ca0-48b8-8e78-c7bf9a588341 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:51.819068 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-d95e801a-7ca0-48b8-8e78-c7bf9a588341 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7" status: 200 len: 1299 microversion: 2.1 time: 0.086531 Aug 24 08:09:51.819963 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 531/1065] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:51 2022] GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7 => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:52.840371 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-07486399-efb2-47ca-b513-581eb18fb544 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:52.841123 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-07486399-efb2-47ca-b513-581eb18fb544 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:52.848354 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-07486399-efb2-47ca-b513-581eb18fb544 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:52.849534 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-07486399-efb2-47ca-b513-581eb18fb544 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:52.849982 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-07486399-efb2-47ca-b513-581eb18fb544 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:52.850887 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-07486399-efb2-47ca-b513-581eb18fb544 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:52.851347 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-07486399-efb2-47ca-b513-581eb18fb544 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:52.851775 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-07486399-efb2-47ca-b513-581eb18fb544 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:52.874002 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-be90befb-ba22-49ed-b854-c00837596125 req-3b78ae98-2982-4ebc-8885-0ff87beda89e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "587fc568-c08c-4e2f-947d-6056b7b952d7", "tag": "ceab8067-a6d7-46e5-b91f-1216faf8c64d"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:09:52.883377 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-be90befb-ba22-49ed-b854-c00837596125 req-3b78ae98-2982-4ebc-8885-0ff87beda89e service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:52.884034 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-be90befb-ba22-49ed-b854-c00837596125 req-3b78ae98-2982-4ebc-8885-0ff87beda89e service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:52.884735 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-be90befb-ba22-49ed-b854-c00837596125 req-3b78ae98-2982-4ebc-8885-0ff87beda89e service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:52.896151 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-be90befb-ba22-49ed-b854-c00837596125 req-3b78ae98-2982-4ebc-8885-0ff87beda89e service nova] Creating event network-changed:ceab8067-a6d7-46e5-b91f-1216faf8c64d for instance 587fc568-c08c-4e2f-947d-6056b7b952d7 on hv-cinder-85427 Aug 24 08:09:52.901257 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-be90befb-ba22-49ed-b854-c00837596125 req-3b78ae98-2982-4ebc-8885-0ff87beda89e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033255 Aug 24 08:09:52.902074 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 532/1066] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:09:53.359477 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-07486399-efb2-47ca-b513-581eb18fb544 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:53.367590 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-07486399-efb2-47ca-b513-581eb18fb544 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7" status: 200 len: 1367 microversion: 2.1 time: 0.532453 Aug 24 08:09:53.368198 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 535/1067] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:52 2022] GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7 => generated 1367 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:54.389878 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-9b38a981-eb81-4903-8297-765957d300f4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:54.390573 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-9b38a981-eb81-4903-8297-765957d300f4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:54.397040 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9b38a981-eb81-4903-8297-765957d300f4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:54.397516 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9b38a981-eb81-4903-8297-765957d300f4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:54.397953 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9b38a981-eb81-4903-8297-765957d300f4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:54.398640 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9b38a981-eb81-4903-8297-765957d300f4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:54.399089 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9b38a981-eb81-4903-8297-765957d300f4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:54.400164 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9b38a981-eb81-4903-8297-765957d300f4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:54.527402 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9b38a981-eb81-4903-8297-765957d300f4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:54.535067 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-9b38a981-eb81-4903-8297-765957d300f4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7" status: 200 len: 1367 microversion: 2.1 time: 0.149857 Aug 24 08:09:54.535629 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 533/1068] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:54 2022] GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:09:55.561818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-cb186cf4-f8e9-4d08-906f-fd69d7ddd99d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:55.562425 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-cb186cf4-f8e9-4d08-906f-fd69d7ddd99d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:55.564694 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=2 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:55.569398 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cb186cf4-f8e9-4d08-906f-fd69d7ddd99d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:55.569876 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cb186cf4-f8e9-4d08-906f-fd69d7ddd99d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:55.570307 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cb186cf4-f8e9-4d08-906f-fd69d7ddd99d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:55.570993 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cb186cf4-f8e9-4d08-906f-fd69d7ddd99d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:55.571534 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cb186cf4-f8e9-4d08-906f-fd69d7ddd99d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:55.572159 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-cb186cf4-f8e9-4d08-906f-fd69d7ddd99d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:55.706683 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-cb186cf4-f8e9-4d08-906f-fd69d7ddd99d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:55.715176 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-cb186cf4-f8e9-4d08-906f-fd69d7ddd99d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7" status: 200 len: 1367 microversion: 2.1 time: 0.157166 Aug 24 08:09:55.720768 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 536/1069] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:55 2022] GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:56.736106 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-51c4b7df-0cc5-4e02-b474-39459ced5d3f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:56.736691 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-51c4b7df-0cc5-4e02-b474-39459ced5d3f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:56.743802 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-51c4b7df-0cc5-4e02-b474-39459ced5d3f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:56.744289 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-51c4b7df-0cc5-4e02-b474-39459ced5d3f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:56.744754 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-51c4b7df-0cc5-4e02-b474-39459ced5d3f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:56.745449 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-51c4b7df-0cc5-4e02-b474-39459ced5d3f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:56.745904 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-51c4b7df-0cc5-4e02-b474-39459ced5d3f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:56.746325 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-51c4b7df-0cc5-4e02-b474-39459ced5d3f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:56.895995 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-51c4b7df-0cc5-4e02-b474-39459ced5d3f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:56.904170 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-51c4b7df-0cc5-4e02-b474-39459ced5d3f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7" status: 200 len: 1367 microversion: 2.1 time: 0.172075 Aug 24 08:09:56.904739 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 534/1070] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:56 2022] GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:57.925197 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-4207ee35-c364-4933-871b-af0e9f8ddca0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:57.925815 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-4207ee35-c364-4933-871b-af0e9f8ddca0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:57.932344 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4207ee35-c364-4933-871b-af0e9f8ddca0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:57.932861 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4207ee35-c364-4933-871b-af0e9f8ddca0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:57.933301 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4207ee35-c364-4933-871b-af0e9f8ddca0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:57.933993 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4207ee35-c364-4933-871b-af0e9f8ddca0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:57.934453 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4207ee35-c364-4933-871b-af0e9f8ddca0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:57.934876 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-4207ee35-c364-4933-871b-af0e9f8ddca0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:58.061584 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-4207ee35-c364-4933-871b-af0e9f8ddca0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:58.069225 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-4207ee35-c364-4933-871b-af0e9f8ddca0 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7" status: 200 len: 1367 microversion: 2.1 time: 0.147956 Aug 24 08:09:58.069794 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 537/1071] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:57 2022] GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:09:59.090366 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-9fcbc6df-f691-4026-9c8a-861770b99bbe tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:09:59.091292 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-9fcbc6df-f691-4026-9c8a-861770b99bbe tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:09:59.094819 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=8 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:59.098500 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9fcbc6df-f691-4026-9c8a-861770b99bbe tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:59.099041 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9fcbc6df-f691-4026-9c8a-861770b99bbe tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:59.099482 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9fcbc6df-f691-4026-9c8a-861770b99bbe tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:59.100184 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9fcbc6df-f691-4026-9c8a-861770b99bbe tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:59.100636 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9fcbc6df-f691-4026-9c8a-861770b99bbe tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:59.101400 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9fcbc6df-f691-4026-9c8a-861770b99bbe tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:59.171227 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-eb623b73-d4fb-4a47-a9de-04d7311fc123 req-6c49a676-5070-466f-bed6-10f7857a4e6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "587fc568-c08c-4e2f-947d-6056b7b952d7", "name": "network-vif-plugged", "status": "completed", "tag": "ceab8067-a6d7-46e5-b91f-1216faf8c64d"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:09:59.177818 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=10 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:59.183121 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-eb623b73-d4fb-4a47-a9de-04d7311fc123 req-6c49a676-5070-466f-bed6-10f7857a4e6e service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:09:59.183240 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-eb623b73-d4fb-4a47-a9de-04d7311fc123 req-6c49a676-5070-466f-bed6-10f7857a4e6e service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:09:59.183571 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-eb623b73-d4fb-4a47-a9de-04d7311fc123 req-6c49a676-5070-466f-bed6-10f7857a4e6e service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:09:59.194892 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-eb623b73-d4fb-4a47-a9de-04d7311fc123 req-6c49a676-5070-466f-bed6-10f7857a4e6e service nova] Creating event network-vif-plugged:ceab8067-a6d7-46e5-b91f-1216faf8c64d for instance 587fc568-c08c-4e2f-947d-6056b7b952d7 on hv-cinder-85427 Aug 24 08:09:59.202674 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-eb623b73-d4fb-4a47-a9de-04d7311fc123 req-6c49a676-5070-466f-bed6-10f7857a4e6e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036174 Aug 24 08:09:59.204442 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 538/1072] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:09:59.240014 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9fcbc6df-f691-4026-9c8a-861770b99bbe tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:09:59.249353 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-9fcbc6df-f691-4026-9c8a-861770b99bbe tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7" status: 200 len: 1367 microversion: 2.1 time: 0.163359 Aug 24 08:09:59.249930 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 535/1073] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:09:59 2022] GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:10:00.272257 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-9f6dd43f-f1d0-4803-b623-fbf7f2c9aad3 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:10:00.272978 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-9f6dd43f-f1d0-4803-b623-fbf7f2c9aad3 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:10:00.279381 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9f6dd43f-f1d0-4803-b623-fbf7f2c9aad3 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:00.279855 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9f6dd43f-f1d0-4803-b623-fbf7f2c9aad3 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:00.280287 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9f6dd43f-f1d0-4803-b623-fbf7f2c9aad3 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:00.280992 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9f6dd43f-f1d0-4803-b623-fbf7f2c9aad3 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:00.281441 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9f6dd43f-f1d0-4803-b623-fbf7f2c9aad3 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:00.281858 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9f6dd43f-f1d0-4803-b623-fbf7f2c9aad3 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:00.408746 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-9f6dd43f-f1d0-4803-b623-fbf7f2c9aad3 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:10:00.417053 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-9f6dd43f-f1d0-4803-b623-fbf7f2c9aad3 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7" status: 200 len: 1367 microversion: 2.1 time: 0.149479 Aug 24 08:10:00.417628 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 539/1074] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:10:00 2022] GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:10:01.438015 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-04536ac5-81c2-4a49-85eb-df9e0bad4b41 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:10:01.438623 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-04536ac5-81c2-4a49-85eb-df9e0bad4b41 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:10:01.445451 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-04536ac5-81c2-4a49-85eb-df9e0bad4b41 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:01.445927 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-04536ac5-81c2-4a49-85eb-df9e0bad4b41 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:01.446356 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-04536ac5-81c2-4a49-85eb-df9e0bad4b41 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:01.447037 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-04536ac5-81c2-4a49-85eb-df9e0bad4b41 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:01.448197 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-04536ac5-81c2-4a49-85eb-df9e0bad4b41 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:01.448531 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-04536ac5-81c2-4a49-85eb-df9e0bad4b41 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:01.573018 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-04536ac5-81c2-4a49-85eb-df9e0bad4b41 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:10:01.580635 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-04536ac5-81c2-4a49-85eb-df9e0bad4b41 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7" status: 200 len: 1556 microversion: 2.1 time: 0.146515 Aug 24 08:10:01.581209 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 536/1075] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:10:01 2022] GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7 => generated 1556 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:10:01.600597 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-6776877a-9b0b-4472-89c6-69f318b20098 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:10:01.601143 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-6776877a-9b0b-4472-89c6-69f318b20098 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:10:01.607626 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6776877a-9b0b-4472-89c6-69f318b20098 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:01.608113 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6776877a-9b0b-4472-89c6-69f318b20098 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:01.608553 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6776877a-9b0b-4472-89c6-69f318b20098 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:01.609278 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6776877a-9b0b-4472-89c6-69f318b20098 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:01.609736 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6776877a-9b0b-4472-89c6-69f318b20098 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:01.610170 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6776877a-9b0b-4472-89c6-69f318b20098 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:01.686072 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-6776877a-9b0b-4472-89c6-69f318b20098 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089395 Aug 24 08:10:01.686675 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 540/1076] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 24 08:10:01 2022] GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:10:02.673461 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-cfceff0c-10a5-433b-8512-c3bd86958259 req-0df77422-2544-4999-97dc-1fcdaec720e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "587fc568-c08c-4e2f-947d-6056b7b952d7", "tag": "ceab8067-a6d7-46e5-b91f-1216faf8c64d"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:10:02.684803 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-cfceff0c-10a5-433b-8512-c3bd86958259 req-0df77422-2544-4999-97dc-1fcdaec720e4 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:02.685296 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-cfceff0c-10a5-433b-8512-c3bd86958259 req-0df77422-2544-4999-97dc-1fcdaec720e4 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:02.685715 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-cfceff0c-10a5-433b-8512-c3bd86958259 req-0df77422-2544-4999-97dc-1fcdaec720e4 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:02.696967 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-cfceff0c-10a5-433b-8512-c3bd86958259 req-0df77422-2544-4999-97dc-1fcdaec720e4 service nova] Creating event network-changed:ceab8067-a6d7-46e5-b91f-1216faf8c64d for instance 587fc568-c08c-4e2f-947d-6056b7b952d7 on hv-cinder-85427 Aug 24 08:10:02.702005 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-cfceff0c-10a5-433b-8512-c3bd86958259 req-0df77422-2544-4999-97dc-1fcdaec720e4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032231 Aug 24 08:10:02.702587 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 537/1077] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:10:36.520438 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=17 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:36.521244 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=35 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:36.525157 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-f4c62109-4a9b-4a7d-80ef-fd158c2865b9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:10:36.525654 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-f4c62109-4a9b-4a7d-80ef-fd158c2865b9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:10:36.531990 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f4c62109-4a9b-4a7d-80ef-fd158c2865b9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:36.540145 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f4c62109-4a9b-4a7d-80ef-fd158c2865b9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:36.540145 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f4c62109-4a9b-4a7d-80ef-fd158c2865b9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:36.540145 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f4c62109-4a9b-4a7d-80ef-fd158c2865b9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:36.540145 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f4c62109-4a9b-4a7d-80ef-fd158c2865b9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:36.540756 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f4c62109-4a9b-4a7d-80ef-fd158c2865b9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:36.560307 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-f4c62109-4a9b-4a7d-80ef-fd158c2865b9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7/ips" status: 200 len: 149 microversion: 2.1 time: 0.041605 Aug 24 08:10:36.560893 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 541/1078] 10.222.0.72 () {58 vars in 1248 bytes} [Wed Aug 24 08:10:36 2022] GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:10:38.283652 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=15 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:38.284394 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=54,nova_cell1:INSERT=1 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:38.288599 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-74a36440-30b2-4255-b8ad-375d67225119 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bee145dd-1992-40b2-b1b3-0c955aceafa5"}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:10:38.291001 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-74a36440-30b2-4255-b8ad-375d67225119 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:10:38.297644 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-74a36440-30b2-4255-b8ad-375d67225119 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:38.300358 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-74a36440-30b2-4255-b8ad-375d67225119 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:38.300358 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-74a36440-30b2-4255-b8ad-375d67225119 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:38.300358 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-74a36440-30b2-4255-b8ad-375d67225119 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:38.300358 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-74a36440-30b2-4255-b8ad-375d67225119 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:38.300923 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-74a36440-30b2-4255-b8ad-375d67225119 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:39.172154 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-74a36440-30b2-4255-b8ad-375d67225119 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "POST /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.889879 Aug 24 08:10:39.172778 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 538/1079] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 24 08:10:38 2022] POST /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7/os-volume_attachments => generated 194 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:10:43.486709 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:10:43.487342 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Wed Aug 24 08:10:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:10:46.696491 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-30d966b4-da5b-46aa-9b2b-0241f6d68965 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bee145dd-1992-40b2-b1b3-0c955aceafa5"}} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:10:46.698857 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-30d966b4-da5b-46aa-9b2b-0241f6d68965 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:10:46.706831 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-30d966b4-da5b-46aa-9b2b-0241f6d68965 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:46.711458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-30d966b4-da5b-46aa-9b2b-0241f6d68965 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:46.711458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-30d966b4-da5b-46aa-9b2b-0241f6d68965 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:46.711458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-30d966b4-da5b-46aa-9b2b-0241f6d68965 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:46.711458 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-30d966b4-da5b-46aa-9b2b-0241f6d68965 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:46.712208 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-30d966b4-da5b-46aa-9b2b-0241f6d68965 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:46.841719 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-30d966b4-da5b-46aa-9b2b-0241f6d68965 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] HTTP exception thrown: Invalid volume: volume bee145dd-1992-40b2-b1b3-0c955aceafa5 is already attached to instances: 587fc568-c08c-4e2f-947d-6056b7b952d7 Aug 24 08:10:46.843457 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-30d966b4-da5b-46aa-9b2b-0241f6d68965 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Request method failure captured: Aug 24 08:10:46.843457 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: POST /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7/os-volume_attachments HTTP/1.1 Aug 24 08:10:46.843457 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 08:10:46.843457 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 08:10:46.843457 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 08:10:46.843457 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 74 Aug 24 08:10:46.843457 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 08:10:46.843457 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 08:10:46.843457 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 08:10:46.843457 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 08:10:46.843457 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdxHOPiPdOZ5uR2SSeO0emctlMLk69rDmbU_apNTseI1EhtGeRqNZVBzCd4zNjmRItzEaz1cDmbEIedCWI4-AP-FzBdtrm_-Z6ZW1yFhxP0pSPtWg21hOmERjLzpQbEdNfRSjetqsS5m07LbvxlL6162IOZUIpN1pT6nBdD4o63LH-Q Aug 24 08:10:46.843457 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 08:10:46.843457 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 08:10:46.843457 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 08:10:46.843457 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 08:10:46.843457 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 08:10:46.843457 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 08:10:46.843457 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: 2d92c8aa6d4d46538574779ae23ac398 Aug 24 08:10:46.843457 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:10:46.843457 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 08:10:46.843457 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 08:10:46.845221 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d92c8aa6d4d46538574779ae23ac398"}]}] Aug 24 08:10:46.845221 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:10:46.845221 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: 2d92c8aa6d4d46538574779ae23ac398 Aug 24 08:10:46.845221 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:10:46.845221 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-AttachVolumeNegativeTest-1826831321-project Aug 24 08:10:46.845221 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 08:10:46.845221 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 08:10:46.845221 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 5344a1d76e764da9b08f4cb7a2bd8ca5 Aug 24 08:10:46.845221 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-AttachVolumeNegativeTest-1826831321-project Aug 24 08:10:46.845221 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Aug 24 08:10:46.845221 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {"volumeAttachment": {"volumeId": "bee145dd-1992-40b2-b1b3-0c955aceafa5"}} Aug 24 08:10:46.845221 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 08:10:46.846245 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Invalid volume: volume bee145dd-1992-40b2-b1b3-0c955aceafa5 is already attached to instances: 587fc568-c08c-4e2f-947d-6056b7b952d7 Aug 24 08:10:46.846245 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'server_id': '587fc568-c08c-4e2f-947d-6056b7b952d7', 'body': {'volumeAttachment': {'volumeId': 'bee145dd-1992-40b2-b1b3-0c955aceafa5'}}} Aug 24 08:10:46.846245 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:10:46.846245 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:10:46.846245 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 08:10:46.846245 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 08:10:46.846245 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 08:10:46.846245 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 08:10:46.846245 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 08:10:46.846245 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 08:10:46.846245 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 08:10:46.846245 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 08:10:46.846245 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 08:10:46.846245 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 08:10:46.846245 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bee145dd-1992-40b2-b1b3-0c955aceafa5 is already attached to instances: 587fc568-c08c-4e2f-947d-6056b7b952d7 Aug 24 08:10:46.846245 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:10:46.846245 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:10:46.846245 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:10:46.846245 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:10:46.848042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:10:46.848042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:10:46.848042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:10:46.848042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:10:46.848042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:10:46.848042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:10:46.848042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 08:10:46.848042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 08:10:46.848042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 08:10:46.848042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 08:10:46.848042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 08:10:46.848042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 08:10:46.848042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 08:10:46.848042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 08:10:46.848042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bee145dd-1992-40b2-b1b3-0c955aceafa5 is already attached to instances: 587fc568-c08c-4e2f-947d-6056b7b952d7 Aug 24 08:10:46.848042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:10:46.848042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:10:46.848042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:10:46.848042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:10:46.848042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:10:46.849909 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:10:46.849909 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:10:46.849909 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:10:46.849909 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bee145dd-1992-40b2-b1b3-0c955aceafa5 is already attached to instances: 587fc568-c08c-4e2f-947d-6056b7b952d7 Aug 24 08:10:46.849909 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:10:46.849909 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-30d966b4-da5b-46aa-9b2b-0241f6d68965 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Returning 400 to user: Invalid volume: volume bee145dd-1992-40b2-b1b3-0c955aceafa5 is already attached to instances: 587fc568-c08c-4e2f-947d-6056b7b952d7 {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:10:46.849909 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-30d966b4-da5b-46aa-9b2b-0241f6d68965 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "POST /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.152387 Aug 24 08:10:46.849909 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 542/1080] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 24 08:10:46 2022] POST /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7/os-volume_attachments => generated 174 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 08:10:46.914325 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-8986bbab-100c-4cd1-b9f2-499ddaabdd6f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:10:46.914928 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-8986bbab-100c-4cd1-b9f2-499ddaabdd6f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:10:46.922587 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8986bbab-100c-4cd1-b9f2-499ddaabdd6f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:46.923072 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8986bbab-100c-4cd1-b9f2-499ddaabdd6f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:46.923516 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8986bbab-100c-4cd1-b9f2-499ddaabdd6f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:46.924248 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8986bbab-100c-4cd1-b9f2-499ddaabdd6f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:46.924730 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8986bbab-100c-4cd1-b9f2-499ddaabdd6f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:46.925162 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-8986bbab-100c-4cd1-b9f2-499ddaabdd6f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:47.005331 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.objects.instance [None req-8986bbab-100c-4cd1-b9f2-499ddaabdd6f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lazy-loading 'services' on Instance uuid 587fc568-c08c-4e2f-947d-6056b7b952d7 {{(pid=127590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:10:47.212496 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-8986bbab-100c-4cd1-b9f2-499ddaabdd6f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "DELETE /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7/os-volume_attachments/bee145dd-1992-40b2-b1b3-0c955aceafa5" status: 202 len: 0 microversion: 2.1 time: 0.302918 Aug 24 08:10:47.213065 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 539/1081] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 24 08:10:46 2022] DELETE /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7/os-volume_attachments/bee145dd-1992-40b2-b1b3-0c955aceafa5 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:10:47.223087 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-8f331846-6289-47ef-8c0d-01bd58205bcf tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:10:47.225262 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-8f331846-6289-47ef-8c0d-01bd58205bcf tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:10:47.231956 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8f331846-6289-47ef-8c0d-01bd58205bcf tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:47.232430 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8f331846-6289-47ef-8c0d-01bd58205bcf tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:47.232956 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8f331846-6289-47ef-8c0d-01bd58205bcf tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:47.233951 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8f331846-6289-47ef-8c0d-01bd58205bcf tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:47.234399 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8f331846-6289-47ef-8c0d-01bd58205bcf tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:47.234865 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8f331846-6289-47ef-8c0d-01bd58205bcf tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:47.264799 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-8f331846-6289-47ef-8c0d-01bd58205bcf tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045856 Aug 24 08:10:47.265345 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 543/1082] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 24 08:10:47 2022] GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:10:48.279016 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-64212100-f118-4c32-827e-267f7a2235c9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:10:48.281374 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-64212100-f118-4c32-827e-267f7a2235c9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:10:48.287703 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-64212100-f118-4c32-827e-267f7a2235c9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:48.288184 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-64212100-f118-4c32-827e-267f7a2235c9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:48.288621 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-64212100-f118-4c32-827e-267f7a2235c9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:48.289353 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-64212100-f118-4c32-827e-267f7a2235c9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:48.289805 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-64212100-f118-4c32-827e-267f7a2235c9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:48.290230 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-64212100-f118-4c32-827e-267f7a2235c9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:48.319131 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-64212100-f118-4c32-827e-267f7a2235c9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045398 Aug 24 08:10:48.319684 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 540/1083] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 24 08:10:48 2022] GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 08:10:48.380551 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-a0527dc3-4c2d-4c20-a4aa-413d1353d48d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:10:48.381115 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-a0527dc3-4c2d-4c20-a4aa-413d1353d48d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:10:48.387926 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a0527dc3-4c2d-4c20-a4aa-413d1353d48d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:48.388410 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a0527dc3-4c2d-4c20-a4aa-413d1353d48d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:48.388879 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a0527dc3-4c2d-4c20-a4aa-413d1353d48d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:48.389582 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a0527dc3-4c2d-4c20-a4aa-413d1353d48d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:48.390038 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a0527dc3-4c2d-4c20-a4aa-413d1353d48d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:48.390468 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-a0527dc3-4c2d-4c20-a4aa-413d1353d48d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:48.416453 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-a0527dc3-4c2d-4c20-a4aa-413d1353d48d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Going to try to terminate instance {{(pid=127589) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:10:48.686325 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-a0527dc3-4c2d-4c20-a4aa-413d1353d48d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "DELETE /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7" status: 204 len: 0 microversion: 2.1 time: 0.309380 Aug 24 08:10:48.686935 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 544/1084] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 24 08:10:48 2022] DELETE /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:10:48.695081 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-bab0e906-bf77-4aac-9c6d-5fb2911c18c2 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:10:48.695768 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-bab0e906-bf77-4aac-9c6d-5fb2911c18c2 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:10:48.701937 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bab0e906-bf77-4aac-9c6d-5fb2911c18c2 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:48.702418 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bab0e906-bf77-4aac-9c6d-5fb2911c18c2 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:48.702859 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bab0e906-bf77-4aac-9c6d-5fb2911c18c2 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:48.703549 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bab0e906-bf77-4aac-9c6d-5fb2911c18c2 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:48.704006 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bab0e906-bf77-4aac-9c6d-5fb2911c18c2 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:48.704432 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-bab0e906-bf77-4aac-9c6d-5fb2911c18c2 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:48.842281 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-bab0e906-bf77-4aac-9c6d-5fb2911c18c2 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:10:48.850025 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-bab0e906-bf77-4aac-9c6d-5fb2911c18c2 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7" status: 200 len: 1681 microversion: 2.1 time: 0.158839 Aug 24 08:10:48.850575 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 541/1085] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:10:48 2022] GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:10:49.872253 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-8e916549-285b-4258-a3a6-f415cfcad28f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:10:49.873006 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-8e916549-285b-4258-a3a6-f415cfcad28f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:10:49.879150 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8e916549-285b-4258-a3a6-f415cfcad28f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:49.879635 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8e916549-285b-4258-a3a6-f415cfcad28f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:49.880072 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8e916549-285b-4258-a3a6-f415cfcad28f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:49.880805 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8e916549-285b-4258-a3a6-f415cfcad28f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:49.881258 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8e916549-285b-4258-a3a6-f415cfcad28f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:49.881726 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-8e916549-285b-4258-a3a6-f415cfcad28f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:50.012224 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-8e916549-285b-4258-a3a6-f415cfcad28f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:10:50.025563 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-8e916549-285b-4258-a3a6-f415cfcad28f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7" status: 200 len: 1681 microversion: 2.1 time: 0.158083 Aug 24 08:10:50.026203 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 545/1086] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:10:49 2022] GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:10:51.048004 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-3a536c97-9274-49c3-97fb-e6174a2803da tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:10:51.048821 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-3a536c97-9274-49c3-97fb-e6174a2803da tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:10:51.055970 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3a536c97-9274-49c3-97fb-e6174a2803da tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:51.059447 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3a536c97-9274-49c3-97fb-e6174a2803da tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:51.059447 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3a536c97-9274-49c3-97fb-e6174a2803da tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:51.059447 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3a536c97-9274-49c3-97fb-e6174a2803da tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:51.059447 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3a536c97-9274-49c3-97fb-e6174a2803da tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:51.059976 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-3a536c97-9274-49c3-97fb-e6174a2803da tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:51.132019 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-3a536c97-9274-49c3-97fb-e6174a2803da tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:10:51.135010 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-3a536c97-9274-49c3-97fb-e6174a2803da tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7" status: 200 len: 1613 microversion: 2.1 time: 0.090823 Aug 24 08:10:51.136217 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 542/1087] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:10:51 2022] GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7 => generated 1613 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:10:51.149167 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-142f9c9e-a5fd-4102-86ed-c8fa5ae02769 req-1131fcfb-9e99-4f73-9a78-a883c4d2fd7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "587fc568-c08c-4e2f-947d-6056b7b952d7", "name": "network-vif-deleted", "tag": "ceab8067-a6d7-46e5-b91f-1216faf8c64d"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:10:51.159654 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-142f9c9e-a5fd-4102-86ed-c8fa5ae02769 req-1131fcfb-9e99-4f73-9a78-a883c4d2fd7e service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:51.165855 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-142f9c9e-a5fd-4102-86ed-c8fa5ae02769 req-1131fcfb-9e99-4f73-9a78-a883c4d2fd7e service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:51.165855 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-142f9c9e-a5fd-4102-86ed-c8fa5ae02769 req-1131fcfb-9e99-4f73-9a78-a883c4d2fd7e service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:51.172255 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-142f9c9e-a5fd-4102-86ed-c8fa5ae02769 req-1131fcfb-9e99-4f73-9a78-a883c4d2fd7e service nova] Creating event network-vif-deleted:ceab8067-a6d7-46e5-b91f-1216faf8c64d for instance 587fc568-c08c-4e2f-947d-6056b7b952d7 on hv-cinder-85427 Aug 24 08:10:51.177229 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-142f9c9e-a5fd-4102-86ed-c8fa5ae02769 req-1131fcfb-9e99-4f73-9a78-a883c4d2fd7e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032348 Aug 24 08:10:51.178064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 546/1088] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:10:52.157767 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-6fdcc626-1f5c-4380-aa44-2798875fb1b4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:10:52.158343 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-6fdcc626-1f5c-4380-aa44-2798875fb1b4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:10:52.165553 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6fdcc626-1f5c-4380-aa44-2798875fb1b4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:52.166172 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6fdcc626-1f5c-4380-aa44-2798875fb1b4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:52.166681 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6fdcc626-1f5c-4380-aa44-2798875fb1b4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:52.167469 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6fdcc626-1f5c-4380-aa44-2798875fb1b4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:52.168022 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6fdcc626-1f5c-4380-aa44-2798875fb1b4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:52.168519 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6fdcc626-1f5c-4380-aa44-2798875fb1b4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:52.208736 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6fdcc626-1f5c-4380-aa44-2798875fb1b4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:52.209180 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6fdcc626-1f5c-4380-aa44-2798875fb1b4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:52.209614 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6fdcc626-1f5c-4380-aa44-2798875fb1b4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:52.210069 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.objects.instance [None req-6fdcc626-1f5c-4380-aa44-2798875fb1b4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lazy-loading 'fault' on Instance uuid 587fc568-c08c-4e2f-947d-6056b7b952d7 {{(pid=127590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:10:52.256021 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-6fdcc626-1f5c-4380-aa44-2798875fb1b4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:10:52.264000 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-6fdcc626-1f5c-4380-aa44-2798875fb1b4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7" status: 200 len: 1331 microversion: 2.1 time: 0.110264 Aug 24 08:10:52.264580 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 543/1089] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:10:52 2022] GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7 => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:10:53.287844 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-9f5e1e22-292a-48c2-b040-28dc9b3871ea tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:10:53.288535 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-9f5e1e22-292a-48c2-b040-28dc9b3871ea tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:10:53.294701 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9f5e1e22-292a-48c2-b040-28dc9b3871ea tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:53.295180 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9f5e1e22-292a-48c2-b040-28dc9b3871ea tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:53.295615 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9f5e1e22-292a-48c2-b040-28dc9b3871ea tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:53.296304 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9f5e1e22-292a-48c2-b040-28dc9b3871ea tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:53.296781 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9f5e1e22-292a-48c2-b040-28dc9b3871ea tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:53.297203 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-9f5e1e22-292a-48c2-b040-28dc9b3871ea tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:53.310576 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-9f5e1e22-292a-48c2-b040-28dc9b3871ea tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] HTTP exception thrown: Instance 587fc568-c08c-4e2f-947d-6056b7b952d7 could not be found. Aug 24 08:10:53.312159 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-9f5e1e22-292a-48c2-b040-28dc9b3871ea tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Request method failure captured: Aug 24 08:10:53.312159 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7 HTTP/1.1 Aug 24 08:10:53.312159 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 08:10:53.312159 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 08:10:53.312159 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 08:10:53.312159 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 08:10:53.312159 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 08:10:53.312159 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 08:10:53.312159 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 08:10:53.312159 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 08:10:53.312159 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdxHOPiPdOZ5uR2SSeO0emctlMLk69rDmbU_apNTseI1EhtGeRqNZVBzCd4zNjmRItzEaz1cDmbEIedCWI4-AP-FzBdtrm_-Z6ZW1yFhxP0pSPtWg21hOmERjLzpQbEdNfRSjetqsS5m07LbvxlL6162IOZUIpN1pT6nBdD4o63LH-Q Aug 24 08:10:53.312159 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 08:10:53.312159 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 08:10:53.312159 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 08:10:53.312159 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 08:10:53.312159 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 08:10:53.312159 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 08:10:53.312159 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: 2d92c8aa6d4d46538574779ae23ac398 Aug 24 08:10:53.312159 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:10:53.312159 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 08:10:53.312159 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 08:10:53.313902 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d92c8aa6d4d46538574779ae23ac398"}]}] Aug 24 08:10:53.313902 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:10:53.313902 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: 2d92c8aa6d4d46538574779ae23ac398 Aug 24 08:10:53.313902 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:10:53.313902 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-AttachVolumeNegativeTest-1826831321-project Aug 24 08:10:53.313902 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 08:10:53.313902 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 08:10:53.313902 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 5344a1d76e764da9b08f4cb7a2bd8ca5 Aug 24 08:10:53.313902 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-AttachVolumeNegativeTest-1826831321-project Aug 24 08:10:53.313902 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 08:10:53.313902 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Instance 587fc568-c08c-4e2f-947d-6056b7b952d7 could not be found. Aug 24 08:10:53.313902 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': '587fc568-c08c-4e2f-947d-6056b7b952d7'} Aug 24 08:10:53.314859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:10:53.314859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:10:53.314859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:10:53.314859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:10:53.314859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:10:53.314859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:10:53.314859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:10:53.314859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:10:53.314859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:10:53.314859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:10:53.314859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 587fc568-c08c-4e2f-947d-6056b7b952d7 could not be found. Aug 24 08:10:53.314859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:10:53.314859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:10:53.314859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:10:53.314859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:10:53.314859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:10:53.314859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:10:53.314859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:10:53.314859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:10:53.314859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:10:53.317345 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:10:53.317345 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:10:53.317345 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:10:53.317345 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:10:53.317345 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:10:53.317345 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:10:53.317345 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:10:53.317345 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 587fc568-c08c-4e2f-947d-6056b7b952d7 could not be found. Aug 24 08:10:53.317345 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:10:53.317345 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:10:53.317345 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:10:53.317345 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:10:53.317345 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:10:53.317345 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:10:53.317345 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:10:53.317345 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:10:53.317345 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 587fc568-c08c-4e2f-947d-6056b7b952d7 could not be found. Aug 24 08:10:53.317345 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:10:53.318883 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-9f5e1e22-292a-48c2-b040-28dc9b3871ea tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Returning 404 to user: Instance 587fc568-c08c-4e2f-947d-6056b7b952d7 could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:10:53.318883 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-9f5e1e22-292a-48c2-b040-28dc9b3871ea tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7" status: 404 len: 111 microversion: 2.1 time: 0.030431 Aug 24 08:10:53.318883 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 547/1090] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:10:53 2022] GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:10:53.322329 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-319bf8b7-599d-439e-97c0-6a7454b4c70c tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '.version_select at 0x7f3210aeeb80>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:10:53.414803 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-319bf8b7-599d-439e-97c0-6a7454b4c70c tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-423132443" status: 202 len: 0 microversion: 2.1 time: 0.096114 Aug 24 08:10:53.415387 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 544/1091] 10.222.0.72 () {58 vars in 1218 bytes} [Wed Aug 24 08:10:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-423132443 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:10:54.185040 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-5584010f-bfa6-4c6d-9373-58361682c785 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Action: 'create', calling method: .version_select at 0x7f320cb4e940>, body: {"keypair": {"name": "tempest-keypair-1422008265", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCezIPhNJFxyKf4cDu3qYZ3CM5Yvm3mLGvdmJRRmEioL+U/fUuOXw4VvbpRpidBWvV8nCQhc41LFfW2HIOYaCX1kP+DOwNW9iwnMup+r0fwdYXxvrKK7ExdNtWCakyDUjw=="}} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:10:54.200531 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.quota [None req-5584010f-bfa6-4c6d-9373-58361682c785 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Getting quotas for project 2d92c8aa6d4d46538574779ae23ac398. Resources: {'key_pairs'} {{(pid=127589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:10:54.204641 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.quota [None req-5584010f-bfa6-4c6d-9373-58361682c785 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Getting quotas for user 5344a1d76e764da9b08f4cb7a2bd8ca5 and project 2d92c8aa6d4d46538574779ae23ac398. Resources: {'key_pairs'} {{(pid=127589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:10:54.312071 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-5584010f-bfa6-4c6d-9373-58361682c785 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.131552 Aug 24 08:10:54.313372 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 548/1092] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 24 08:10:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:10:56.517389 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-5aae37d1-1fd4-4631-acfa-c1adcf345bfb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1419221824", "imageRef": "ccdab334-55ce-4ff5-bd97-5a424660c282", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2af2cfe3-fbb0-4b30-a7f7-b293ddfab728"}], "security_groups": [{"name": "tempest-securitygroup--574361668"}], "key_name": "tempest-keypair-1422008265", "user_data": "}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:10:56.618699 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.network.neutron [None req-5aae37d1-1fd4-4631-acfa-c1adcf345bfb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] validate_networks() for [('2af2cfe3-fbb0-4b30-a7f7-b293ddfab728', None, None, None, None, None)] {{(pid=127590) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:10:56.982112 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-5aae37d1-1fd4-4631-acfa-c1adcf345bfb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Flavor limits 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:10:56.982542 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-5aae37d1-1fd4-4631-acfa-c1adcf345bfb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Image limits 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:10:56.983027 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-5aae37d1-1fd4-4631-acfa-c1adcf345bfb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Flavor pref 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:10:56.983429 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-5aae37d1-1fd4-4631-acfa-c1adcf345bfb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Image pref 0:0:0 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:10:56.983834 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.virt.hardware [None req-5aae37d1-1fd4-4631-acfa-c1adcf345bfb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:10:56.992713 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5aae37d1-1fd4-4631-acfa-c1adcf345bfb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:56.993189 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5aae37d1-1fd4-4631-acfa-c1adcf345bfb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:56.993613 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5aae37d1-1fd4-4631-acfa-c1adcf345bfb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:56.994326 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5aae37d1-1fd4-4631-acfa-c1adcf345bfb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:56.994770 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5aae37d1-1fd4-4631-acfa-c1adcf345bfb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:56.995185 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-5aae37d1-1fd4-4631-acfa-c1adcf345bfb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:57.011279 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-5aae37d1-1fd4-4631-acfa-c1adcf345bfb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Getting quotas for project 2d92c8aa6d4d46538574779ae23ac398. Resources: {'cores', 'instances', 'ram'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:10:57.015678 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.quota [None req-5aae37d1-1fd4-4631-acfa-c1adcf345bfb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Getting quotas for user 5344a1d76e764da9b08f4cb7a2bd8ca5 and project 2d92c8aa6d4d46538574779ae23ac398. Resources: {'cores', 'instances', 'ram'} {{(pid=127590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:10:57.026522 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-5aae37d1-1fd4-4631-acfa-c1adcf345bfb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Going to run 1 instances... {{(pid=127590) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:10:57.029663 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-5aae37d1-1fd4-4631-acfa-c1adcf345bfb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 6beba3bc-ab09-45a9-a68f-a3581fffec02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccdab334-55ce-4ff5-bd97-5a424660c282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:10:57.159787 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-5aae37d1-1fd4-4631-acfa-c1adcf345bfb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.647160 Aug 24 08:10:57.160328 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 545/1093] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 24 08:10:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 08:10:57.171801 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-747bc644-6821-4bc3-a469-1d330b1e5077 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:10:57.172447 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-747bc644-6821-4bc3-a469-1d330b1e5077 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 6beba3bc-ab09-45a9-a68f-a3581fffec02] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:10:57.231425 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-747bc644-6821-4bc3-a469-1d330b1e5077 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:10:57.238999 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-747bc644-6821-4bc3-a469-1d330b1e5077 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02" status: 200 len: 1242 microversion: 2.1 time: 0.071474 Aug 24 08:10:57.239497 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 549/1094] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:10:57 2022] GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02 => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:10:58.260075 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-b342ec35-adfb-4b99-81ea-685cc9e21bc9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:10:58.260776 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-b342ec35-adfb-4b99-81ea-685cc9e21bc9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 6beba3bc-ab09-45a9-a68f-a3581fffec02] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:10:58.267981 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b342ec35-adfb-4b99-81ea-685cc9e21bc9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:58.268468 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b342ec35-adfb-4b99-81ea-685cc9e21bc9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:58.268933 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b342ec35-adfb-4b99-81ea-685cc9e21bc9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:58.269637 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b342ec35-adfb-4b99-81ea-685cc9e21bc9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:58.270092 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b342ec35-adfb-4b99-81ea-685cc9e21bc9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:58.270520 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b342ec35-adfb-4b99-81ea-685cc9e21bc9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:58.330898 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-b342ec35-adfb-4b99-81ea-685cc9e21bc9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:10:58.339114 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-b342ec35-adfb-4b99-81ea-685cc9e21bc9 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02" status: 200 len: 1246 microversion: 2.1 time: 0.083531 Aug 24 08:10:58.340221 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 546/1095] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:10:58 2022] GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:10:59.360169 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-58809e7b-eb1f-4deb-a9b0-e7f716c2c006 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:10:59.360801 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-58809e7b-eb1f-4deb-a9b0-e7f716c2c006 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 6beba3bc-ab09-45a9-a68f-a3581fffec02] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:10:59.368092 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-58809e7b-eb1f-4deb-a9b0-e7f716c2c006 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:59.369167 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-58809e7b-eb1f-4deb-a9b0-e7f716c2c006 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:59.369463 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-58809e7b-eb1f-4deb-a9b0-e7f716c2c006 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:59.370171 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-58809e7b-eb1f-4deb-a9b0-e7f716c2c006 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:10:59.370625 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-58809e7b-eb1f-4deb-a9b0-e7f716c2c006 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:10:59.371616 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-58809e7b-eb1f-4deb-a9b0-e7f716c2c006 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:10:59.448063 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-58809e7b-eb1f-4deb-a9b0-e7f716c2c006 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:10:59.455889 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-58809e7b-eb1f-4deb-a9b0-e7f716c2c006 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02" status: 200 len: 1300 microversion: 2.1 time: 0.099640 Aug 24 08:10:59.456464 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 550/1096] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:10:59 2022] GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02 => generated 1300 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:11:00.480895 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-b325e325-11fb-4dfc-98d1-f37598b0cc25 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:11:00.481505 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-b325e325-11fb-4dfc-98d1-f37598b0cc25 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 6beba3bc-ab09-45a9-a68f-a3581fffec02] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:11:00.488728 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b325e325-11fb-4dfc-98d1-f37598b0cc25 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:00.489216 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b325e325-11fb-4dfc-98d1-f37598b0cc25 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:00.489650 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b325e325-11fb-4dfc-98d1-f37598b0cc25 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:00.490353 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b325e325-11fb-4dfc-98d1-f37598b0cc25 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:00.490801 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b325e325-11fb-4dfc-98d1-f37598b0cc25 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:00.491225 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b325e325-11fb-4dfc-98d1-f37598b0cc25 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:00.630051 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-b325e325-11fb-4dfc-98d1-f37598b0cc25 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:11:00.638862 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-b325e325-11fb-4dfc-98d1-f37598b0cc25 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02" status: 200 len: 1367 microversion: 2.1 time: 0.161938 Aug 24 08:11:00.639651 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 547/1097] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:11:00 2022] GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:11:01.048071 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-1477acc3-b9d8-4837-a84d-47dedbc23959 req-89c468ff-65d6-4dd3-9921-72c13663c4eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6beba3bc-ab09-45a9-a68f-a3581fffec02", "tag": "78dc44be-e137-4c5f-9a0a-fbf7cc4bc305"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:11:01.058964 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-1477acc3-b9d8-4837-a84d-47dedbc23959 req-89c468ff-65d6-4dd3-9921-72c13663c4eb service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:01.065262 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-1477acc3-b9d8-4837-a84d-47dedbc23959 req-89c468ff-65d6-4dd3-9921-72c13663c4eb service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:01.065262 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-1477acc3-b9d8-4837-a84d-47dedbc23959 req-89c468ff-65d6-4dd3-9921-72c13663c4eb service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:01.071197 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-1477acc3-b9d8-4837-a84d-47dedbc23959 req-89c468ff-65d6-4dd3-9921-72c13663c4eb service nova] Creating event network-changed:78dc44be-e137-4c5f-9a0a-fbf7cc4bc305 for instance 6beba3bc-ab09-45a9-a68f-a3581fffec02 on hv-cinder-85427 Aug 24 08:11:01.076312 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-1477acc3-b9d8-4837-a84d-47dedbc23959 req-89c468ff-65d6-4dd3-9921-72c13663c4eb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031985 Aug 24 08:11:01.077174 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 551/1098] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:11:01.659905 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-9b282b8b-7087-4d13-8a7b-cb07f965dc00 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:11:01.660628 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-9b282b8b-7087-4d13-8a7b-cb07f965dc00 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 6beba3bc-ab09-45a9-a68f-a3581fffec02] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:11:01.667138 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9b282b8b-7087-4d13-8a7b-cb07f965dc00 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:01.667626 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9b282b8b-7087-4d13-8a7b-cb07f965dc00 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:01.668069 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9b282b8b-7087-4d13-8a7b-cb07f965dc00 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:01.668810 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9b282b8b-7087-4d13-8a7b-cb07f965dc00 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:01.669273 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9b282b8b-7087-4d13-8a7b-cb07f965dc00 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:01.669700 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9b282b8b-7087-4d13-8a7b-cb07f965dc00 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:01.796545 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9b282b8b-7087-4d13-8a7b-cb07f965dc00 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:11:01.804259 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-9b282b8b-7087-4d13-8a7b-cb07f965dc00 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02" status: 200 len: 1367 microversion: 2.1 time: 0.148382 Aug 24 08:11:01.804857 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 548/1099] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:11:01 2022] GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:11:02.825944 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-e4617f22-d4c9-4093-8db0-706178bbf8bb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:11:02.826703 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-e4617f22-d4c9-4093-8db0-706178bbf8bb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 6beba3bc-ab09-45a9-a68f-a3581fffec02] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:11:02.832906 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e4617f22-d4c9-4093-8db0-706178bbf8bb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:02.833420 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e4617f22-d4c9-4093-8db0-706178bbf8bb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:02.833859 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e4617f22-d4c9-4093-8db0-706178bbf8bb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:02.834558 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e4617f22-d4c9-4093-8db0-706178bbf8bb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:02.835013 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e4617f22-d4c9-4093-8db0-706178bbf8bb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:02.835442 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-e4617f22-d4c9-4093-8db0-706178bbf8bb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:02.968045 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-e4617f22-d4c9-4093-8db0-706178bbf8bb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:11:02.975740 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-e4617f22-d4c9-4093-8db0-706178bbf8bb tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02" status: 200 len: 1367 microversion: 2.1 time: 0.154536 Aug 24 08:11:02.976310 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 552/1100] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:11:02 2022] GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:11:03.997785 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-6fe5d9c3-78ad-4f56-bddc-6b88de663f38 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:11:03.998396 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-6fe5d9c3-78ad-4f56-bddc-6b88de663f38 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 6beba3bc-ab09-45a9-a68f-a3581fffec02] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:11:04.004892 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6fe5d9c3-78ad-4f56-bddc-6b88de663f38 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:04.005372 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6fe5d9c3-78ad-4f56-bddc-6b88de663f38 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:04.005806 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6fe5d9c3-78ad-4f56-bddc-6b88de663f38 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:04.006495 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6fe5d9c3-78ad-4f56-bddc-6b88de663f38 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:04.006953 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6fe5d9c3-78ad-4f56-bddc-6b88de663f38 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:04.007376 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-6fe5d9c3-78ad-4f56-bddc-6b88de663f38 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:04.133493 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-6fe5d9c3-78ad-4f56-bddc-6b88de663f38 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:11:04.141186 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-6fe5d9c3-78ad-4f56-bddc-6b88de663f38 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02" status: 200 len: 1367 microversion: 2.1 time: 0.148248 Aug 24 08:11:04.141739 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 549/1101] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:11:03 2022] GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:11:05.162590 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-db3bb44a-576f-4ebd-8c90-e175973d720d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:11:05.163230 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-db3bb44a-576f-4ebd-8c90-e175973d720d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 6beba3bc-ab09-45a9-a68f-a3581fffec02] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:11:05.170267 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-db3bb44a-576f-4ebd-8c90-e175973d720d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:05.170753 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-db3bb44a-576f-4ebd-8c90-e175973d720d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:05.171189 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-db3bb44a-576f-4ebd-8c90-e175973d720d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:05.171886 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-db3bb44a-576f-4ebd-8c90-e175973d720d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:05.172339 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-db3bb44a-576f-4ebd-8c90-e175973d720d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:05.172802 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-db3bb44a-576f-4ebd-8c90-e175973d720d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:05.301292 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-db3bb44a-576f-4ebd-8c90-e175973d720d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:11:05.308508 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-db3bb44a-576f-4ebd-8c90-e175973d720d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02" status: 200 len: 1367 microversion: 2.1 time: 0.149794 Aug 24 08:11:05.321481 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 553/1102] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:11:05 2022] GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:11:06.329254 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-29a53e2a-e2db-4312-b6c0-fff82a5e834f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:11:06.329897 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-29a53e2a-e2db-4312-b6c0-fff82a5e834f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 6beba3bc-ab09-45a9-a68f-a3581fffec02] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:11:06.336279 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-29a53e2a-e2db-4312-b6c0-fff82a5e834f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:06.336791 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-29a53e2a-e2db-4312-b6c0-fff82a5e834f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:06.337233 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-29a53e2a-e2db-4312-b6c0-fff82a5e834f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:06.337920 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-29a53e2a-e2db-4312-b6c0-fff82a5e834f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:06.338372 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-29a53e2a-e2db-4312-b6c0-fff82a5e834f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:06.338795 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-29a53e2a-e2db-4312-b6c0-fff82a5e834f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:06.477221 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-29a53e2a-e2db-4312-b6c0-fff82a5e834f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:11:06.486008 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-29a53e2a-e2db-4312-b6c0-fff82a5e834f tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02" status: 200 len: 1367 microversion: 2.1 time: 0.160567 Aug 24 08:11:06.486584 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 550/1103] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:11:06 2022] GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:11:07.508358 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [req-17a2ed9e-9d79-4a1c-a450-ee7ad183f09f req-d9708d37-c31e-4e9e-adee-2ec073b81cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6beba3bc-ab09-45a9-a68f-a3581fffec02", "name": "network-vif-plugged", "status": "completed", "tag": "78dc44be-e137-4c5f-9a0a-fbf7cc4bc305"}]} {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:11:07.515558 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell0:SELECT=6 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:07.516234 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-9cc4d7c3-3bbc-4163-8fc0-f94c70312fe4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:11:07.516936 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-9cc4d7c3-3bbc-4163-8fc0-f94c70312fe4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 6beba3bc-ab09-45a9-a68f-a3581fffec02] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:11:07.519570 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=2 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:07.519907 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-17a2ed9e-9d79-4a1c-a450-ee7ad183f09f req-d9708d37-c31e-4e9e-adee-2ec073b81cc2 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:07.520331 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell0:SELECT=6 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:07.520473 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-17a2ed9e-9d79-4a1c-a450-ee7ad183f09f req-d9708d37-c31e-4e9e-adee-2ec073b81cc2 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:07.521003 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [req-17a2ed9e-9d79-4a1c-a450-ee7ad183f09f req-d9708d37-c31e-4e9e-adee-2ec073b81cc2 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:07.526489 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9cc4d7c3-3bbc-4163-8fc0-f94c70312fe4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:07.527789 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9cc4d7c3-3bbc-4163-8fc0-f94c70312fe4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:07.527994 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9cc4d7c3-3bbc-4163-8fc0-f94c70312fe4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:07.528720 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9cc4d7c3-3bbc-4163-8fc0-f94c70312fe4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:07.529243 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9cc4d7c3-3bbc-4163-8fc0-f94c70312fe4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:07.529669 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-9cc4d7c3-3bbc-4163-8fc0-f94c70312fe4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:07.532579 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.compute.server_external_events [req-17a2ed9e-9d79-4a1c-a450-ee7ad183f09f req-d9708d37-c31e-4e9e-adee-2ec073b81cc2 service nova] Creating event network-vif-plugged:78dc44be-e137-4c5f-9a0a-fbf7cc4bc305 for instance 6beba3bc-ab09-45a9-a68f-a3581fffec02 on hv-cinder-85427 Aug 24 08:11:07.539180 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [req-17a2ed9e-9d79-4a1c-a450-ee7ad183f09f req-d9708d37-c31e-4e9e-adee-2ec073b81cc2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035109 Aug 24 08:11:07.539180 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 554/1104] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:11:07.666372 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-9cc4d7c3-3bbc-4163-8fc0-f94c70312fe4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:11:07.674152 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-9cc4d7c3-3bbc-4163-8fc0-f94c70312fe4 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02" status: 200 len: 1367 microversion: 2.1 time: 0.168105 Aug 24 08:11:07.674724 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 551/1105] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:11:07 2022] GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:11:08.695495 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-fa0a60df-b859-4d78-af89-7c89f8f7a886 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:11:08.696100 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-fa0a60df-b859-4d78-af89-7c89f8f7a886 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 6beba3bc-ab09-45a9-a68f-a3581fffec02] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:11:08.702447 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fa0a60df-b859-4d78-af89-7c89f8f7a886 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:08.702922 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fa0a60df-b859-4d78-af89-7c89f8f7a886 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:08.703354 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fa0a60df-b859-4d78-af89-7c89f8f7a886 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:08.704037 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fa0a60df-b859-4d78-af89-7c89f8f7a886 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:08.704484 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fa0a60df-b859-4d78-af89-7c89f8f7a886 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:08.705026 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-fa0a60df-b859-4d78-af89-7c89f8f7a886 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:08.834728 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-fa0a60df-b859-4d78-af89-7c89f8f7a886 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:11:08.843025 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-fa0a60df-b859-4d78-af89-7c89f8f7a886 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02" status: 200 len: 1367 microversion: 2.1 time: 0.152579 Aug 24 08:11:08.843587 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 555/1106] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:11:08 2022] GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:11:09.864300 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-35fdeed6-b7e3-49ad-aa3d-6fafad4ceeab tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:11:09.864921 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-35fdeed6-b7e3-49ad-aa3d-6fafad4ceeab tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 6beba3bc-ab09-45a9-a68f-a3581fffec02] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:11:09.867809 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:09.873428 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-35fdeed6-b7e3-49ad-aa3d-6fafad4ceeab tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:09.873916 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-35fdeed6-b7e3-49ad-aa3d-6fafad4ceeab tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:09.874357 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-35fdeed6-b7e3-49ad-aa3d-6fafad4ceeab tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:09.875053 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-35fdeed6-b7e3-49ad-aa3d-6fafad4ceeab tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:09.875513 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-35fdeed6-b7e3-49ad-aa3d-6fafad4ceeab tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:09.875943 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-35fdeed6-b7e3-49ad-aa3d-6fafad4ceeab tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:09.878583 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:10.243766 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-35fdeed6-b7e3-49ad-aa3d-6fafad4ceeab tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:11:10.251743 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-35fdeed6-b7e3-49ad-aa3d-6fafad4ceeab tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02" status: 200 len: 1556 microversion: 2.1 time: 0.391246 Aug 24 08:11:10.252231 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 552/1107] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:11:09 2022] GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02 => generated 1556 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:11:10.271967 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-94d15392-99e0-4fb4-9eb8-3d117a015977 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:11:10.272485 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-94d15392-99e0-4fb4-9eb8-3d117a015977 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 6beba3bc-ab09-45a9-a68f-a3581fffec02] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:11:10.279532 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-94d15392-99e0-4fb4-9eb8-3d117a015977 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:10.280038 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-94d15392-99e0-4fb4-9eb8-3d117a015977 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:10.280471 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-94d15392-99e0-4fb4-9eb8-3d117a015977 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:10.281195 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-94d15392-99e0-4fb4-9eb8-3d117a015977 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:10.281645 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-94d15392-99e0-4fb4-9eb8-3d117a015977 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:10.282073 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-94d15392-99e0-4fb4-9eb8-3d117a015977 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:10.357190 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-94d15392-99e0-4fb4-9eb8-3d117a015977 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089080 Aug 24 08:11:10.357787 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 556/1108] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 24 08:11:10 2022] GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:11:11.330627 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-dd122721-c73f-47de-b384-c55b5533d6bc req-859eecbe-6dc2-4854-b763-2fe368b50fdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6beba3bc-ab09-45a9-a68f-a3581fffec02", "tag": "78dc44be-e137-4c5f-9a0a-fbf7cc4bc305"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:11:11.340431 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-dd122721-c73f-47de-b384-c55b5533d6bc req-859eecbe-6dc2-4854-b763-2fe368b50fdc service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:11.340946 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-dd122721-c73f-47de-b384-c55b5533d6bc req-859eecbe-6dc2-4854-b763-2fe368b50fdc service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:11.341386 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-dd122721-c73f-47de-b384-c55b5533d6bc req-859eecbe-6dc2-4854-b763-2fe368b50fdc service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:11.352358 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-dd122721-c73f-47de-b384-c55b5533d6bc req-859eecbe-6dc2-4854-b763-2fe368b50fdc service nova] Creating event network-changed:78dc44be-e137-4c5f-9a0a-fbf7cc4bc305 for instance 6beba3bc-ab09-45a9-a68f-a3581fffec02 on hv-cinder-85427 Aug 24 08:11:11.357981 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-dd122721-c73f-47de-b384-c55b5533d6bc req-859eecbe-6dc2-4854-b763-2fe368b50fdc service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031051 Aug 24 08:11:11.358760 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 553/1109] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:11:45.081952 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:45.082726 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:45.086630 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-404fafad-d976-42b6-a0f3-d284d4781091 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:11:45.087122 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-404fafad-d976-42b6-a0f3-d284d4781091 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 6beba3bc-ab09-45a9-a68f-a3581fffec02] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:11:45.092907 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-404fafad-d976-42b6-a0f3-d284d4781091 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:45.093391 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-404fafad-d976-42b6-a0f3-d284d4781091 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:45.093955 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-404fafad-d976-42b6-a0f3-d284d4781091 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:45.094591 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-404fafad-d976-42b6-a0f3-d284d4781091 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:45.095044 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-404fafad-d976-42b6-a0f3-d284d4781091 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:45.095466 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-404fafad-d976-42b6-a0f3-d284d4781091 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:45.118476 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-404fafad-d976-42b6-a0f3-d284d4781091 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02/ips" status: 200 len: 148 microversion: 2.1 time: 0.038025 Aug 24 08:11:45.119042 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 557/1110] 10.222.0.72 () {58 vars in 1248 bytes} [Wed Aug 24 08:11:45 2022] GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:11:46.641362 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-b564b6ce-e458-491f-9e21-9df29e8999bf tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "baa24493-fbb2-47f2-8544-cf32c20caa84"}} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:11:46.644400 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-b564b6ce-e458-491f-9e21-9df29e8999bf tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 6beba3bc-ab09-45a9-a68f-a3581fffec02] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:11:46.646666 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=3 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:46.647439 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=7 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:46.652505 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b564b6ce-e458-491f-9e21-9df29e8999bf tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:46.653101 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b564b6ce-e458-491f-9e21-9df29e8999bf tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:46.653543 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b564b6ce-e458-491f-9e21-9df29e8999bf tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:46.654248 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b564b6ce-e458-491f-9e21-9df29e8999bf tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:46.654800 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b564b6ce-e458-491f-9e21-9df29e8999bf tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:46.655216 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-b564b6ce-e458-491f-9e21-9df29e8999bf tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:47.278499 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-b564b6ce-e458-491f-9e21-9df29e8999bf tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "POST /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.641826 Aug 24 08:11:47.279027 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 554/1111] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 24 08:11:46 2022] POST /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02/os-volume_attachments => generated 194 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:11:54.892863 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-579bca74-7cf2-4f75-a36d-185b1622654e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:11:54.893443 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-579bca74-7cf2-4f75-a36d-185b1622654e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 6beba3bc-ab09-45a9-a68f-a3581fffec02] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:11:54.900867 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-579bca74-7cf2-4f75-a36d-185b1622654e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:54.901355 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-579bca74-7cf2-4f75-a36d-185b1622654e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:54.901795 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-579bca74-7cf2-4f75-a36d-185b1622654e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:54.902497 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-579bca74-7cf2-4f75-a36d-185b1622654e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:54.902961 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-579bca74-7cf2-4f75-a36d-185b1622654e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:54.903386 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-579bca74-7cf2-4f75-a36d-185b1622654e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:54.985062 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.objects.instance [None req-579bca74-7cf2-4f75-a36d-185b1622654e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lazy-loading 'services' on Instance uuid 6beba3bc-ab09-45a9-a68f-a3581fffec02 {{(pid=127589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:11:55.165556 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-579bca74-7cf2-4f75-a36d-185b1622654e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "DELETE /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02/os-volume_attachments/baa24493-fbb2-47f2-8544-cf32c20caa84" status: 202 len: 0 microversion: 2.1 time: 0.277246 Aug 24 08:11:55.166143 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 558/1112] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 24 08:11:54 2022] DELETE /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02/os-volume_attachments/baa24493-fbb2-47f2-8544-cf32c20caa84 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 08:11:55.175489 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-d33a4f1e-b15b-426a-b544-2d33a3782cf3 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:11:55.177896 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-d33a4f1e-b15b-426a-b544-2d33a3782cf3 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 6beba3bc-ab09-45a9-a68f-a3581fffec02] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:11:55.184028 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d33a4f1e-b15b-426a-b544-2d33a3782cf3 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:55.184516 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d33a4f1e-b15b-426a-b544-2d33a3782cf3 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:55.184919 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d33a4f1e-b15b-426a-b544-2d33a3782cf3 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:55.188143 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d33a4f1e-b15b-426a-b544-2d33a3782cf3 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:55.188143 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d33a4f1e-b15b-426a-b544-2d33a3782cf3 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:55.188143 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-d33a4f1e-b15b-426a-b544-2d33a3782cf3 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:55.216352 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-d33a4f1e-b15b-426a-b544-2d33a3782cf3 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045671 Aug 24 08:11:55.222528 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 555/1113] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 24 08:11:55 2022] GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:11:56.231057 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-2cb3e10e-3f1c-442a-a4e1-640ea1f1bb1d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:11:56.233448 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-2cb3e10e-3f1c-442a-a4e1-640ea1f1bb1d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 6beba3bc-ab09-45a9-a68f-a3581fffec02] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:11:56.240241 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2cb3e10e-3f1c-442a-a4e1-640ea1f1bb1d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:56.240749 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2cb3e10e-3f1c-442a-a4e1-640ea1f1bb1d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:56.241188 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2cb3e10e-3f1c-442a-a4e1-640ea1f1bb1d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:56.241880 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2cb3e10e-3f1c-442a-a4e1-640ea1f1bb1d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:56.242336 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2cb3e10e-3f1c-442a-a4e1-640ea1f1bb1d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:56.242760 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-2cb3e10e-3f1c-442a-a4e1-640ea1f1bb1d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:56.271243 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-2cb3e10e-3f1c-442a-a4e1-640ea1f1bb1d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045335 Aug 24 08:11:56.272019 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 559/1114] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 24 08:11:56 2022] GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 08:11:56.332951 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-ef4b0726-3a11-4622-b03a-3625ffc9cf6c tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:11:56.333496 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-ef4b0726-3a11-4622-b03a-3625ffc9cf6c tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 6beba3bc-ab09-45a9-a68f-a3581fffec02] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:11:56.339660 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ef4b0726-3a11-4622-b03a-3625ffc9cf6c tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:56.340149 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ef4b0726-3a11-4622-b03a-3625ffc9cf6c tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:56.340588 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ef4b0726-3a11-4622-b03a-3625ffc9cf6c tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:56.341329 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ef4b0726-3a11-4622-b03a-3625ffc9cf6c tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:56.341784 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ef4b0726-3a11-4622-b03a-3625ffc9cf6c tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:56.342211 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-ef4b0726-3a11-4622-b03a-3625ffc9cf6c tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:56.368040 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-ef4b0726-3a11-4622-b03a-3625ffc9cf6c tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 6beba3bc-ab09-45a9-a68f-a3581fffec02] Going to try to terminate instance {{(pid=127590) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:11:56.651041 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-ef4b0726-3a11-4622-b03a-3625ffc9cf6c tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "DELETE /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02" status: 204 len: 0 microversion: 2.1 time: 0.321679 Aug 24 08:11:56.651633 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 556/1115] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 24 08:11:56 2022] DELETE /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:11:56.659992 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-b4386974-07cf-4145-b42e-87e6d6ccaf0e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:11:56.660843 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-b4386974-07cf-4145-b42e-87e6d6ccaf0e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 6beba3bc-ab09-45a9-a68f-a3581fffec02] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:11:56.668166 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b4386974-07cf-4145-b42e-87e6d6ccaf0e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:56.668716 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b4386974-07cf-4145-b42e-87e6d6ccaf0e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:56.669148 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b4386974-07cf-4145-b42e-87e6d6ccaf0e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:56.669829 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b4386974-07cf-4145-b42e-87e6d6ccaf0e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:56.670280 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b4386974-07cf-4145-b42e-87e6d6ccaf0e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:56.670696 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-b4386974-07cf-4145-b42e-87e6d6ccaf0e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:56.799301 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-b4386974-07cf-4145-b42e-87e6d6ccaf0e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:11:56.807040 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-b4386974-07cf-4145-b42e-87e6d6ccaf0e tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02" status: 200 len: 1680 microversion: 2.1 time: 0.151057 Aug 24 08:11:56.807597 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 560/1116] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:11:56 2022] GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:11:57.828938 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-31516739-5a86-4847-8f6c-fcc4f3f7e4d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:11:57.829646 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-31516739-5a86-4847-8f6c-fcc4f3f7e4d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 6beba3bc-ab09-45a9-a68f-a3581fffec02] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:11:57.836031 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-31516739-5a86-4847-8f6c-fcc4f3f7e4d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:57.836507 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-31516739-5a86-4847-8f6c-fcc4f3f7e4d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:57.836969 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-31516739-5a86-4847-8f6c-fcc4f3f7e4d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:57.837659 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-31516739-5a86-4847-8f6c-fcc4f3f7e4d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:57.838112 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-31516739-5a86-4847-8f6c-fcc4f3f7e4d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:57.838536 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-31516739-5a86-4847-8f6c-fcc4f3f7e4d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:57.968836 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.policy [None req-31516739-5a86-4847-8f6c-fcc4f3f7e4d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:11:57.977237 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-31516739-5a86-4847-8f6c-fcc4f3f7e4d7 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02" status: 200 len: 1680 microversion: 2.1 time: 0.152530 Aug 24 08:11:57.977792 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 557/1117] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:11:57 2022] GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:11:58.998950 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-0ea45b90-7621-45a8-9ccc-0c7d9996094b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:11:58.999585 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-0ea45b90-7621-45a8-9ccc-0c7d9996094b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 6beba3bc-ab09-45a9-a68f-a3581fffec02] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:11:59.007322 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0ea45b90-7621-45a8-9ccc-0c7d9996094b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:59.007814 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0ea45b90-7621-45a8-9ccc-0c7d9996094b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:59.008261 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0ea45b90-7621-45a8-9ccc-0c7d9996094b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:59.008998 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0ea45b90-7621-45a8-9ccc-0c7d9996094b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:59.009456 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0ea45b90-7621-45a8-9ccc-0c7d9996094b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:59.009915 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-0ea45b90-7621-45a8-9ccc-0c7d9996094b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:59.040607 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [req-f2c5998f-3a97-4f5f-a5e9-c20efe75779c req-21282896-1779-4217-bb6a-8706365f3ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6beba3bc-ab09-45a9-a68f-a3581fffec02", "name": "network-vif-deleted", "tag": "78dc44be-e137-4c5f-9a0a-fbf7cc4bc305"}]} {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:11:59.051914 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-f2c5998f-3a97-4f5f-a5e9-c20efe75779c req-21282896-1779-4217-bb6a-8706365f3ee0 service nova] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:11:59.054186 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-f2c5998f-3a97-4f5f-a5e9-c20efe75779c req-21282896-1779-4217-bb6a-8706365f3ee0 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:11:59.054186 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [req-f2c5998f-3a97-4f5f-a5e9-c20efe75779c req-21282896-1779-4217-bb6a-8706365f3ee0 service nova] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:11:59.065672 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.compute.server_external_events [req-f2c5998f-3a97-4f5f-a5e9-c20efe75779c req-21282896-1779-4217-bb6a-8706365f3ee0 service nova] Creating event network-vif-deleted:78dc44be-e137-4c5f-9a0a-fbf7cc4bc305 for instance 6beba3bc-ab09-45a9-a68f-a3581fffec02 on hv-cinder-85427 Aug 24 08:11:59.071618 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [req-f2c5998f-3a97-4f5f-a5e9-c20efe75779c req-21282896-1779-4217-bb6a-8706365f3ee0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034997 Aug 24 08:11:59.072589 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 558/1118] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 24 08:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:11:59.085130 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.policy [None req-0ea45b90-7621-45a8-9ccc-0c7d9996094b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5344a1d76e764da9b08f4cb7a2bd8ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d92c8aa6d4d46538574779ae23ac398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:11:59.094843 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-0ea45b90-7621-45a8-9ccc-0c7d9996094b tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02" status: 200 len: 1613 microversion: 2.1 time: 0.100159 Aug 24 08:11:59.095801 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 561/1119] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:11:58 2022] GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02 => generated 1613 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:12:00.117119 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-c5b2d814-1ab8-42ac-9fed-614769c8c633 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:12:00.117813 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-c5b2d814-1ab8-42ac-9fed-614769c8c633 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 6beba3bc-ab09-45a9-a68f-a3581fffec02] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:12:00.124025 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c5b2d814-1ab8-42ac-9fed-614769c8c633 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:12:00.124501 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c5b2d814-1ab8-42ac-9fed-614769c8c633 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:12:00.124950 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c5b2d814-1ab8-42ac-9fed-614769c8c633 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:12:00.125705 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c5b2d814-1ab8-42ac-9fed-614769c8c633 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:12:00.126149 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c5b2d814-1ab8-42ac-9fed-614769c8c633 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:12:00.126566 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-c5b2d814-1ab8-42ac-9fed-614769c8c633 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:12:00.139881 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.wsgi [None req-c5b2d814-1ab8-42ac-9fed-614769c8c633 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] HTTP exception thrown: Instance 6beba3bc-ab09-45a9-a68f-a3581fffec02 could not be found. Aug 24 08:12:00.141759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-c5b2d814-1ab8-42ac-9fed-614769c8c633 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Request method failure captured: Aug 24 08:12:00.141759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: request: GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02 HTTP/1.1 Aug 24 08:12:00.141759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept: application/json Aug 24 08:12:00.141759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept-Encoding: identity Aug 24 08:12:00.141759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Connection: close Aug 24 08:12:00.141759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Length: 0 Aug 24 08:12:00.141759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Type: application/json Aug 24 08:12:00.141759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Host: 10.222.0.72 Aug 24 08:12:00.141759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Openstack-System-Scope: None Aug 24 08:12:00.141759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: User-Agent: python-urllib3/1.26.11 Aug 24 08:12:00.141759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Auth-Token: gAAAAABjBdxHOPiPdOZ5uR2SSeO0emctlMLk69rDmbU_apNTseI1EhtGeRqNZVBzCd4zNjmRItzEaz1cDmbEIedCWI4-AP-FzBdtrm_-Z6ZW1yFhxP0pSPtWg21hOmERjLzpQbEdNfRSjetqsS5m07LbvxlL6162IOZUIpN1pT6nBdD4o63LH-Q Aug 24 08:12:00.141759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Id: None Aug 24 08:12:00.141759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Name: None Aug 24 08:12:00.141759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Identity-Status: Confirmed Aug 24 08:12:00.141759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Is-Admin-Project: True Aug 24 08:12:00.141759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Id: default Aug 24 08:12:00.141759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Name: Default Aug 24 08:12:00.141759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Id: 2d92c8aa6d4d46538574779ae23ac398 Aug 24 08:12:00.141759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Name: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:12:00.141759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Role: reader,member Aug 24 08:12:00.141759 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Roles: reader,member Aug 24 08:12:00.143541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d92c8aa6d4d46538574779ae23ac398"}]}] Aug 24 08:12:00.143541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:12:00.143541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Id: 2d92c8aa6d4d46538574779ae23ac398 Aug 24 08:12:00.143541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:12:00.143541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User: tempest-AttachVolumeNegativeTest-1826831321-project Aug 24 08:12:00.143541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Id: default Aug 24 08:12:00.143541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Name: Default Aug 24 08:12:00.143541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Id: 5344a1d76e764da9b08f4cb7a2bd8ca5 Aug 24 08:12:00.143541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Name: tempest-AttachVolumeNegativeTest-1826831321-project Aug 24 08:12:00.143541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: method: > Aug 24 08:12:00.143541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: exception: Instance 6beba3bc-ab09-45a9-a68f-a3581fffec02 could not be found. Aug 24 08:12:00.143541 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: action_args: {'id': '6beba3bc-ab09-45a9-a68f-a3581fffec02'} Aug 24 08:12:00.144550 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:12:00.144550 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:00.144550 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:12:00.144550 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:12:00.144550 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:12:00.144550 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:12:00.144550 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:12:00.144550 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:12:00.144550 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:12:00.144550 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:12:00.144550 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6beba3bc-ab09-45a9-a68f-a3581fffec02 could not be found. Aug 24 08:12:00.144550 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:12:00.144550 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:12:00.144550 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:12:00.144550 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:00.144550 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:12:00.144550 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:12:00.144550 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:12:00.144550 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:12:00.144550 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:12:00.146872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:12:00.146872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:12:00.146872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:12:00.146872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:12:00.146872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:12:00.146872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:12:00.146872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:12:00.146872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6beba3bc-ab09-45a9-a68f-a3581fffec02 could not be found. Aug 24 08:12:00.146872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:12:00.146872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:12:00.146872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:12:00.146872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:00.146872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:12:00.146872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:12:00.146872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:12:00.146872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:12:00.146872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6beba3bc-ab09-45a9-a68f-a3581fffec02 could not be found. Aug 24 08:12:00.146872 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:12:00.148687 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-c5b2d814-1ab8-42ac-9fed-614769c8c633 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Returning 404 to user: Instance 6beba3bc-ab09-45a9-a68f-a3581fffec02 could not be found. {{(pid=127590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:12:00.148687 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-c5b2d814-1ab8-42ac-9fed-614769c8c633 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02" status: 404 len: 111 microversion: 2.1 time: 0.031374 Aug 24 08:12:00.148687 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 559/1120] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:12:00 2022] GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:12:00.152874 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-bf555c8b-67d2-47c5-859a-a96f0400ecc5 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '.version_select at 0x7f320cd20e50>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:12:00.256353 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-bf555c8b-67d2-47c5-859a-a96f0400ecc5 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1422008265" status: 202 len: 0 microversion: 2.1 time: 0.107509 Aug 24 08:12:00.256973 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 562/1121] 10.222.0.72 () {58 vars in 1221 bytes} [Wed Aug 24 08:12:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1422008265 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 08:12:02.307883 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-4f4dd8b7-a63f-4860-893a-ad00aefa74fe tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:12:02.308388 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-4f4dd8b7-a63f-4860-893a-ad00aefa74fe tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 6beba3bc-ab09-45a9-a68f-a3581fffec02] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:12:02.314791 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4f4dd8b7-a63f-4860-893a-ad00aefa74fe tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:12:02.315270 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4f4dd8b7-a63f-4860-893a-ad00aefa74fe tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:12:02.315708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4f4dd8b7-a63f-4860-893a-ad00aefa74fe tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:12:02.316399 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4f4dd8b7-a63f-4860-893a-ad00aefa74fe tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:12:02.316888 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4f4dd8b7-a63f-4860-893a-ad00aefa74fe tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:12:02.317314 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-4f4dd8b7-a63f-4860-893a-ad00aefa74fe tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:12:02.331145 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.wsgi [None req-4f4dd8b7-a63f-4860-893a-ad00aefa74fe tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] HTTP exception thrown: Instance 6beba3bc-ab09-45a9-a68f-a3581fffec02 could not be found. Aug 24 08:12:02.332678 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-4f4dd8b7-a63f-4860-893a-ad00aefa74fe tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Request method failure captured: Aug 24 08:12:02.332678 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: request: DELETE /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02 HTTP/1.1 Aug 24 08:12:02.332678 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept: application/json Aug 24 08:12:02.332678 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept-Encoding: identity Aug 24 08:12:02.332678 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Connection: close Aug 24 08:12:02.332678 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Length: 0 Aug 24 08:12:02.332678 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Type: application/json Aug 24 08:12:02.332678 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Host: 10.222.0.72 Aug 24 08:12:02.332678 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Openstack-System-Scope: None Aug 24 08:12:02.332678 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: User-Agent: python-urllib3/1.26.11 Aug 24 08:12:02.332678 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Auth-Token: gAAAAABjBdxHOPiPdOZ5uR2SSeO0emctlMLk69rDmbU_apNTseI1EhtGeRqNZVBzCd4zNjmRItzEaz1cDmbEIedCWI4-AP-FzBdtrm_-Z6ZW1yFhxP0pSPtWg21hOmERjLzpQbEdNfRSjetqsS5m07LbvxlL6162IOZUIpN1pT6nBdD4o63LH-Q Aug 24 08:12:02.332678 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Id: None Aug 24 08:12:02.332678 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Name: None Aug 24 08:12:02.332678 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Identity-Status: Confirmed Aug 24 08:12:02.332678 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Is-Admin-Project: True Aug 24 08:12:02.332678 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Id: default Aug 24 08:12:02.332678 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Name: Default Aug 24 08:12:02.332678 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Id: 2d92c8aa6d4d46538574779ae23ac398 Aug 24 08:12:02.332678 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Name: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:12:02.332678 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Role: reader,member Aug 24 08:12:02.332678 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Roles: reader,member Aug 24 08:12:02.334786 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d92c8aa6d4d46538574779ae23ac398"}]}] Aug 24 08:12:02.334786 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:12:02.334786 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Id: 2d92c8aa6d4d46538574779ae23ac398 Aug 24 08:12:02.334786 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:12:02.334786 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User: tempest-AttachVolumeNegativeTest-1826831321-project Aug 24 08:12:02.334786 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Id: default Aug 24 08:12:02.334786 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Name: Default Aug 24 08:12:02.334786 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Id: 5344a1d76e764da9b08f4cb7a2bd8ca5 Aug 24 08:12:02.334786 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Name: tempest-AttachVolumeNegativeTest-1826831321-project Aug 24 08:12:02.334786 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: method: > Aug 24 08:12:02.334786 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: exception: Instance 6beba3bc-ab09-45a9-a68f-a3581fffec02 could not be found. Aug 24 08:12:02.334786 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: action_args: {'id': '6beba3bc-ab09-45a9-a68f-a3581fffec02'} Aug 24 08:12:02.335666 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:12:02.335666 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:02.335666 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:12:02.335666 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:12:02.335666 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:12:02.335666 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:12:02.335666 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:12:02.335666 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:12:02.335666 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:12:02.335666 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:12:02.335666 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6beba3bc-ab09-45a9-a68f-a3581fffec02 could not be found. Aug 24 08:12:02.335666 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:12:02.335666 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:12:02.335666 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:12:02.335666 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:02.335666 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:12:02.335666 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:12:02.335666 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:12:02.335666 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:12:02.335666 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:12:02.337305 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:12:02.337305 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 08:12:02.337305 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 08:12:02.337305 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 08:12:02.337305 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 08:12:02.337305 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:12:02.337305 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:12:02.337305 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:12:02.337305 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:12:02.337305 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6beba3bc-ab09-45a9-a68f-a3581fffec02 could not be found. Aug 24 08:12:02.337305 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:12:02.337305 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:12:02.337305 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:12:02.337305 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:02.337305 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:12:02.337305 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:12:02.337305 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:12:02.337305 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:12:02.337305 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6beba3bc-ab09-45a9-a68f-a3581fffec02 could not be found. Aug 24 08:12:02.337305 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:12:02.339018 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-4f4dd8b7-a63f-4860-893a-ad00aefa74fe tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Returning 404 to user: Instance 6beba3bc-ab09-45a9-a68f-a3581fffec02 could not be found. {{(pid=127590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:12:02.339018 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-4f4dd8b7-a63f-4860-893a-ad00aefa74fe tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "DELETE /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02" status: 404 len: 111 microversion: 2.1 time: 0.030644 Aug 24 08:12:02.339018 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 560/1122] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 24 08:12:02 2022] DELETE /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:12:02.342966 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-c7b7dd16-250b-47d6-a338-2b637a012591 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:12:02.343573 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-c7b7dd16-250b-47d6-a338-2b637a012591 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 6beba3bc-ab09-45a9-a68f-a3581fffec02] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:12:02.350749 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c7b7dd16-250b-47d6-a338-2b637a012591 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:12:02.351226 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c7b7dd16-250b-47d6-a338-2b637a012591 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:12:02.351659 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c7b7dd16-250b-47d6-a338-2b637a012591 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:12:02.352351 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c7b7dd16-250b-47d6-a338-2b637a012591 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:12:02.352841 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c7b7dd16-250b-47d6-a338-2b637a012591 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:12:02.353260 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-c7b7dd16-250b-47d6-a338-2b637a012591 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:12:02.366698 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-c7b7dd16-250b-47d6-a338-2b637a012591 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] HTTP exception thrown: Instance 6beba3bc-ab09-45a9-a68f-a3581fffec02 could not be found. Aug 24 08:12:02.368329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-c7b7dd16-250b-47d6-a338-2b637a012591 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Request method failure captured: Aug 24 08:12:02.368329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02 HTTP/1.1 Aug 24 08:12:02.368329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 08:12:02.368329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 08:12:02.368329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 08:12:02.368329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 08:12:02.368329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 08:12:02.368329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 08:12:02.368329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 08:12:02.368329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 08:12:02.368329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdxHOPiPdOZ5uR2SSeO0emctlMLk69rDmbU_apNTseI1EhtGeRqNZVBzCd4zNjmRItzEaz1cDmbEIedCWI4-AP-FzBdtrm_-Z6ZW1yFhxP0pSPtWg21hOmERjLzpQbEdNfRSjetqsS5m07LbvxlL6162IOZUIpN1pT6nBdD4o63LH-Q Aug 24 08:12:02.368329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 08:12:02.368329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 08:12:02.368329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 08:12:02.368329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 08:12:02.368329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 08:12:02.368329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 08:12:02.368329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: 2d92c8aa6d4d46538574779ae23ac398 Aug 24 08:12:02.368329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:12:02.368329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 08:12:02.368329 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 08:12:02.369962 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d92c8aa6d4d46538574779ae23ac398"}]}] Aug 24 08:12:02.369962 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:12:02.369962 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: 2d92c8aa6d4d46538574779ae23ac398 Aug 24 08:12:02.369962 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:12:02.369962 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-AttachVolumeNegativeTest-1826831321-project Aug 24 08:12:02.369962 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 08:12:02.369962 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 08:12:02.369962 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 5344a1d76e764da9b08f4cb7a2bd8ca5 Aug 24 08:12:02.369962 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-AttachVolumeNegativeTest-1826831321-project Aug 24 08:12:02.369962 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 08:12:02.369962 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Instance 6beba3bc-ab09-45a9-a68f-a3581fffec02 could not be found. Aug 24 08:12:02.369962 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': '6beba3bc-ab09-45a9-a68f-a3581fffec02'} Aug 24 08:12:02.370979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:12:02.370979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:02.370979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:12:02.370979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:12:02.370979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:12:02.370979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:12:02.370979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:12:02.370979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:12:02.370979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:12:02.370979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:12:02.370979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6beba3bc-ab09-45a9-a68f-a3581fffec02 could not be found. Aug 24 08:12:02.370979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:12:02.370979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:12:02.370979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:12:02.370979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:02.370979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:12:02.370979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:12:02.370979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:12:02.370979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:12:02.370979 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:12:02.372599 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:12:02.372599 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:12:02.372599 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:12:02.372599 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:12:02.372599 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:12:02.372599 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:12:02.372599 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:12:02.372599 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6beba3bc-ab09-45a9-a68f-a3581fffec02 could not be found. Aug 24 08:12:02.372599 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:12:02.372599 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:12:02.372599 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:12:02.372599 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:02.372599 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:12:02.372599 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:12:02.372599 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:12:02.372599 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:12:02.372599 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6beba3bc-ab09-45a9-a68f-a3581fffec02 could not be found. Aug 24 08:12:02.372599 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:12:02.373993 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-c7b7dd16-250b-47d6-a338-2b637a012591 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Returning 404 to user: Instance 6beba3bc-ab09-45a9-a68f-a3581fffec02 could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:12:02.373993 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-c7b7dd16-250b-47d6-a338-2b637a012591 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02" status: 404 len: 111 microversion: 2.1 time: 0.030600 Aug 24 08:12:02.373993 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 563/1123] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:12:02 2022] GET /compute/v2.1/servers/6beba3bc-ab09-45a9-a68f-a3581fffec02 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:12:03.649380 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-949fc726-b141-4eee-99eb-6a6b8f716198 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:12:03.649934 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-949fc726-b141-4eee-99eb-6a6b8f716198 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:12:03.656229 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-949fc726-b141-4eee-99eb-6a6b8f716198 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:12:03.656643 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-949fc726-b141-4eee-99eb-6a6b8f716198 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:12:03.657107 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-949fc726-b141-4eee-99eb-6a6b8f716198 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:12:03.657788 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-949fc726-b141-4eee-99eb-6a6b8f716198 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:12:03.658235 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-949fc726-b141-4eee-99eb-6a6b8f716198 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:12:03.658654 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-949fc726-b141-4eee-99eb-6a6b8f716198 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:12:03.673110 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.wsgi [None req-949fc726-b141-4eee-99eb-6a6b8f716198 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] HTTP exception thrown: Instance 587fc568-c08c-4e2f-947d-6056b7b952d7 could not be found. Aug 24 08:12:03.674638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-949fc726-b141-4eee-99eb-6a6b8f716198 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Request method failure captured: Aug 24 08:12:03.674638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: request: DELETE /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7 HTTP/1.1 Aug 24 08:12:03.674638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept: application/json Aug 24 08:12:03.674638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept-Encoding: identity Aug 24 08:12:03.674638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Connection: close Aug 24 08:12:03.674638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Length: 0 Aug 24 08:12:03.674638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Type: application/json Aug 24 08:12:03.674638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Host: 10.222.0.72 Aug 24 08:12:03.674638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Openstack-System-Scope: None Aug 24 08:12:03.674638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: User-Agent: python-urllib3/1.26.11 Aug 24 08:12:03.674638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Auth-Token: gAAAAABjBdxHOPiPdOZ5uR2SSeO0emctlMLk69rDmbU_apNTseI1EhtGeRqNZVBzCd4zNjmRItzEaz1cDmbEIedCWI4-AP-FzBdtrm_-Z6ZW1yFhxP0pSPtWg21hOmERjLzpQbEdNfRSjetqsS5m07LbvxlL6162IOZUIpN1pT6nBdD4o63LH-Q Aug 24 08:12:03.674638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Id: None Aug 24 08:12:03.674638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Name: None Aug 24 08:12:03.674638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Identity-Status: Confirmed Aug 24 08:12:03.674638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Is-Admin-Project: True Aug 24 08:12:03.674638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Id: default Aug 24 08:12:03.674638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Name: Default Aug 24 08:12:03.674638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Id: 2d92c8aa6d4d46538574779ae23ac398 Aug 24 08:12:03.674638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Name: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:12:03.674638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Role: reader,member Aug 24 08:12:03.674638 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Roles: reader,member Aug 24 08:12:03.677244 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d92c8aa6d4d46538574779ae23ac398"}]}] Aug 24 08:12:03.677244 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:12:03.677244 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Id: 2d92c8aa6d4d46538574779ae23ac398 Aug 24 08:12:03.677244 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:12:03.677244 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User: tempest-AttachVolumeNegativeTest-1826831321-project Aug 24 08:12:03.677244 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Id: default Aug 24 08:12:03.677244 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Name: Default Aug 24 08:12:03.677244 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Id: 5344a1d76e764da9b08f4cb7a2bd8ca5 Aug 24 08:12:03.677244 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Name: tempest-AttachVolumeNegativeTest-1826831321-project Aug 24 08:12:03.677244 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: method: > Aug 24 08:12:03.677244 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: exception: Instance 587fc568-c08c-4e2f-947d-6056b7b952d7 could not be found. Aug 24 08:12:03.677244 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: action_args: {'id': '587fc568-c08c-4e2f-947d-6056b7b952d7'} Aug 24 08:12:03.678242 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:12:03.678242 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:03.678242 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:12:03.678242 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:12:03.678242 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:12:03.678242 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:12:03.678242 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:12:03.678242 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:12:03.678242 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:12:03.678242 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:12:03.678242 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 587fc568-c08c-4e2f-947d-6056b7b952d7 could not be found. Aug 24 08:12:03.678242 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:12:03.678242 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:12:03.678242 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:12:03.678242 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:03.678242 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:12:03.678242 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:12:03.678242 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:12:03.678242 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:12:03.678242 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:12:03.680083 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:12:03.680083 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 08:12:03.680083 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 08:12:03.680083 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 08:12:03.680083 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 08:12:03.680083 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:12:03.680083 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:12:03.680083 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:12:03.680083 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:12:03.680083 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 587fc568-c08c-4e2f-947d-6056b7b952d7 could not be found. Aug 24 08:12:03.680083 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:12:03.680083 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:12:03.680083 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:12:03.680083 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:03.680083 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:12:03.680083 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:12:03.680083 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:12:03.680083 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:12:03.680083 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 587fc568-c08c-4e2f-947d-6056b7b952d7 could not be found. Aug 24 08:12:03.680083 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:12:03.681747 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-949fc726-b141-4eee-99eb-6a6b8f716198 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Returning 404 to user: Instance 587fc568-c08c-4e2f-947d-6056b7b952d7 could not be found. {{(pid=127590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:12:03.681747 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-949fc726-b141-4eee-99eb-6a6b8f716198 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "DELETE /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7" status: 404 len: 111 microversion: 2.1 time: 0.031313 Aug 24 08:12:03.681747 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 561/1124] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 24 08:12:03 2022] DELETE /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:12:03.684938 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-6a0e1c48-7412-4196-a00a-b296b566301d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:12:03.685563 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-6a0e1c48-7412-4196-a00a-b296b566301d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: 587fc568-c08c-4e2f-947d-6056b7b952d7] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:12:03.692270 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6a0e1c48-7412-4196-a00a-b296b566301d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:12:03.693364 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6a0e1c48-7412-4196-a00a-b296b566301d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:12:03.693775 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6a0e1c48-7412-4196-a00a-b296b566301d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:12:03.694480 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6a0e1c48-7412-4196-a00a-b296b566301d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:12:03.694938 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6a0e1c48-7412-4196-a00a-b296b566301d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:12:03.695364 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-6a0e1c48-7412-4196-a00a-b296b566301d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:12:03.709244 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-6a0e1c48-7412-4196-a00a-b296b566301d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] HTTP exception thrown: Instance 587fc568-c08c-4e2f-947d-6056b7b952d7 could not be found. Aug 24 08:12:03.710776 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-6a0e1c48-7412-4196-a00a-b296b566301d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Request method failure captured: Aug 24 08:12:03.710776 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7 HTTP/1.1 Aug 24 08:12:03.710776 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 08:12:03.710776 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 08:12:03.710776 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 08:12:03.710776 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 08:12:03.710776 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 08:12:03.710776 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 08:12:03.710776 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 08:12:03.710776 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 08:12:03.710776 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdxHOPiPdOZ5uR2SSeO0emctlMLk69rDmbU_apNTseI1EhtGeRqNZVBzCd4zNjmRItzEaz1cDmbEIedCWI4-AP-FzBdtrm_-Z6ZW1yFhxP0pSPtWg21hOmERjLzpQbEdNfRSjetqsS5m07LbvxlL6162IOZUIpN1pT6nBdD4o63LH-Q Aug 24 08:12:03.710776 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 08:12:03.710776 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 08:12:03.710776 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 08:12:03.710776 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 08:12:03.710776 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 08:12:03.710776 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 08:12:03.710776 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: 2d92c8aa6d4d46538574779ae23ac398 Aug 24 08:12:03.710776 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:12:03.710776 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 08:12:03.710776 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 08:12:03.712516 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d92c8aa6d4d46538574779ae23ac398"}]}] Aug 24 08:12:03.712516 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:12:03.712516 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: 2d92c8aa6d4d46538574779ae23ac398 Aug 24 08:12:03.712516 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:12:03.712516 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-AttachVolumeNegativeTest-1826831321-project Aug 24 08:12:03.712516 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 08:12:03.712516 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 08:12:03.712516 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 5344a1d76e764da9b08f4cb7a2bd8ca5 Aug 24 08:12:03.712516 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-AttachVolumeNegativeTest-1826831321-project Aug 24 08:12:03.712516 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 08:12:03.712516 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Instance 587fc568-c08c-4e2f-947d-6056b7b952d7 could not be found. Aug 24 08:12:03.712516 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': '587fc568-c08c-4e2f-947d-6056b7b952d7'} Aug 24 08:12:03.713464 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:12:03.713464 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:03.713464 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:12:03.713464 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:12:03.713464 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:12:03.713464 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:12:03.713464 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:12:03.713464 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:12:03.713464 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:12:03.713464 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:12:03.713464 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 587fc568-c08c-4e2f-947d-6056b7b952d7 could not be found. Aug 24 08:12:03.713464 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:12:03.713464 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:12:03.713464 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:12:03.713464 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:03.713464 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:12:03.713464 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:12:03.713464 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:12:03.713464 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:12:03.713464 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:12:03.715044 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:12:03.715044 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:12:03.715044 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:12:03.715044 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:12:03.715044 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:12:03.715044 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:12:03.715044 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:12:03.715044 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 587fc568-c08c-4e2f-947d-6056b7b952d7 could not be found. Aug 24 08:12:03.715044 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:12:03.715044 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:12:03.715044 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:12:03.715044 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:03.715044 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:12:03.715044 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:12:03.715044 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:12:03.715044 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:12:03.715044 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 587fc568-c08c-4e2f-947d-6056b7b952d7 could not be found. Aug 24 08:12:03.715044 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:12:03.716411 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-6a0e1c48-7412-4196-a00a-b296b566301d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Returning 404 to user: Instance 587fc568-c08c-4e2f-947d-6056b7b952d7 could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:12:03.716411 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-6a0e1c48-7412-4196-a00a-b296b566301d tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7" status: 404 len: 111 microversion: 2.1 time: 0.031249 Aug 24 08:12:03.716411 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 564/1125] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:12:03 2022] GET /compute/v2.1/servers/587fc568-c08c-4e2f-947d-6056b7b952d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:12:03.720938 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-dbe85542-0d1b-4726-b925-9b3033917319 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:12:03.721430 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-dbe85542-0d1b-4726-b925-9b3033917319 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:12:03.727390 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dbe85542-0d1b-4726-b925-9b3033917319 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:12:03.727857 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dbe85542-0d1b-4726-b925-9b3033917319 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:12:03.728284 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dbe85542-0d1b-4726-b925-9b3033917319 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:12:03.728991 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dbe85542-0d1b-4726-b925-9b3033917319 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:12:03.729442 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dbe85542-0d1b-4726-b925-9b3033917319 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:12:03.729868 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-dbe85542-0d1b-4726-b925-9b3033917319 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:12:03.743288 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.wsgi [None req-dbe85542-0d1b-4726-b925-9b3033917319 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] HTTP exception thrown: Instance f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 could not be found. Aug 24 08:12:03.744867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-dbe85542-0d1b-4726-b925-9b3033917319 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Request method failure captured: Aug 24 08:12:03.744867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: request: DELETE /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 HTTP/1.1 Aug 24 08:12:03.744867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept: application/json Aug 24 08:12:03.744867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept-Encoding: identity Aug 24 08:12:03.744867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Connection: close Aug 24 08:12:03.744867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Length: 0 Aug 24 08:12:03.744867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Type: application/json Aug 24 08:12:03.744867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Host: 10.222.0.72 Aug 24 08:12:03.744867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Openstack-System-Scope: None Aug 24 08:12:03.744867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: User-Agent: python-urllib3/1.26.11 Aug 24 08:12:03.744867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Auth-Token: gAAAAABjBdxHOPiPdOZ5uR2SSeO0emctlMLk69rDmbU_apNTseI1EhtGeRqNZVBzCd4zNjmRItzEaz1cDmbEIedCWI4-AP-FzBdtrm_-Z6ZW1yFhxP0pSPtWg21hOmERjLzpQbEdNfRSjetqsS5m07LbvxlL6162IOZUIpN1pT6nBdD4o63LH-Q Aug 24 08:12:03.744867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Id: None Aug 24 08:12:03.744867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Name: None Aug 24 08:12:03.744867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Identity-Status: Confirmed Aug 24 08:12:03.744867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Is-Admin-Project: True Aug 24 08:12:03.744867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Id: default Aug 24 08:12:03.744867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Name: Default Aug 24 08:12:03.744867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Id: 2d92c8aa6d4d46538574779ae23ac398 Aug 24 08:12:03.744867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Name: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:12:03.744867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Role: reader,member Aug 24 08:12:03.744867 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Roles: reader,member Aug 24 08:12:03.746581 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d92c8aa6d4d46538574779ae23ac398"}]}] Aug 24 08:12:03.746581 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:12:03.746581 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Id: 2d92c8aa6d4d46538574779ae23ac398 Aug 24 08:12:03.746581 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:12:03.746581 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User: tempest-AttachVolumeNegativeTest-1826831321-project Aug 24 08:12:03.746581 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Id: default Aug 24 08:12:03.746581 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Name: Default Aug 24 08:12:03.746581 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Id: 5344a1d76e764da9b08f4cb7a2bd8ca5 Aug 24 08:12:03.746581 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Name: tempest-AttachVolumeNegativeTest-1826831321-project Aug 24 08:12:03.746581 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: method: > Aug 24 08:12:03.746581 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: exception: Instance f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 could not be found. Aug 24 08:12:03.746581 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: action_args: {'id': 'f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0'} Aug 24 08:12:03.747507 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:12:03.747507 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:03.747507 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:12:03.747507 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:12:03.747507 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:12:03.747507 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:12:03.747507 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:12:03.747507 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:12:03.747507 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:12:03.747507 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:12:03.747507 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 could not be found. Aug 24 08:12:03.747507 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:12:03.747507 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:12:03.747507 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:12:03.747507 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:03.747507 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:12:03.747507 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:12:03.747507 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:12:03.747507 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:12:03.747507 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:12:03.749125 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:12:03.749125 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 08:12:03.749125 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 08:12:03.749125 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 08:12:03.749125 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 08:12:03.749125 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:12:03.749125 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:12:03.749125 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:12:03.749125 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:12:03.749125 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 could not be found. Aug 24 08:12:03.749125 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:12:03.749125 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:12:03.749125 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:12:03.749125 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:03.749125 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:12:03.749125 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:12:03.749125 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:12:03.749125 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:12:03.749125 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 could not be found. Aug 24 08:12:03.749125 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:12:03.750664 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-dbe85542-0d1b-4726-b925-9b3033917319 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Returning 404 to user: Instance f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 could not be found. {{(pid=127590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:12:03.750664 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-dbe85542-0d1b-4726-b925-9b3033917319 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0" status: 404 len: 111 microversion: 2.1 time: 0.029282 Aug 24 08:12:03.750664 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 562/1126] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 24 08:12:03 2022] DELETE /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:12:03.754562 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-741288bd-7718-4c4f-9056-4d0a367c7513 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:12:03.755167 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-741288bd-7718-4c4f-9056-4d0a367c7513 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:12:03.763501 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-741288bd-7718-4c4f-9056-4d0a367c7513 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:12:03.763982 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-741288bd-7718-4c4f-9056-4d0a367c7513 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:12:03.764414 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-741288bd-7718-4c4f-9056-4d0a367c7513 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:12:03.766587 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-741288bd-7718-4c4f-9056-4d0a367c7513 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:12:03.766587 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-741288bd-7718-4c4f-9056-4d0a367c7513 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:12:03.766587 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-741288bd-7718-4c4f-9056-4d0a367c7513 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:12:03.780474 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-741288bd-7718-4c4f-9056-4d0a367c7513 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] HTTP exception thrown: Instance f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 could not be found. Aug 24 08:12:03.782064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-741288bd-7718-4c4f-9056-4d0a367c7513 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Request method failure captured: Aug 24 08:12:03.782064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 HTTP/1.1 Aug 24 08:12:03.782064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 08:12:03.782064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 08:12:03.782064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 08:12:03.782064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 08:12:03.782064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 08:12:03.782064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 08:12:03.782064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 08:12:03.782064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 08:12:03.782064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdxHOPiPdOZ5uR2SSeO0emctlMLk69rDmbU_apNTseI1EhtGeRqNZVBzCd4zNjmRItzEaz1cDmbEIedCWI4-AP-FzBdtrm_-Z6ZW1yFhxP0pSPtWg21hOmERjLzpQbEdNfRSjetqsS5m07LbvxlL6162IOZUIpN1pT6nBdD4o63LH-Q Aug 24 08:12:03.782064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 08:12:03.782064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 08:12:03.782064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 08:12:03.782064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 08:12:03.782064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 08:12:03.782064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 08:12:03.782064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: 2d92c8aa6d4d46538574779ae23ac398 Aug 24 08:12:03.782064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:12:03.782064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 08:12:03.782064 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 08:12:03.783800 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d92c8aa6d4d46538574779ae23ac398"}]}] Aug 24 08:12:03.783800 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:12:03.783800 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: 2d92c8aa6d4d46538574779ae23ac398 Aug 24 08:12:03.783800 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:12:03.783800 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-AttachVolumeNegativeTest-1826831321-project Aug 24 08:12:03.783800 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 08:12:03.783800 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 08:12:03.783800 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 5344a1d76e764da9b08f4cb7a2bd8ca5 Aug 24 08:12:03.783800 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-AttachVolumeNegativeTest-1826831321-project Aug 24 08:12:03.783800 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 08:12:03.783800 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Instance f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 could not be found. Aug 24 08:12:03.783800 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': 'f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0'} Aug 24 08:12:03.784730 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:12:03.784730 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:03.784730 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:12:03.784730 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:12:03.784730 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:12:03.784730 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:12:03.784730 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:12:03.784730 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:12:03.784730 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:12:03.784730 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:12:03.784730 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 could not be found. Aug 24 08:12:03.784730 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:12:03.784730 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:12:03.784730 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:12:03.784730 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:03.784730 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:12:03.784730 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:12:03.784730 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:12:03.784730 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:12:03.784730 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:12:03.786076 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:12:03.786076 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:12:03.786076 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:12:03.786076 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:12:03.786076 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:12:03.786076 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:12:03.786076 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:12:03.786076 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 could not be found. Aug 24 08:12:03.786076 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:12:03.786076 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:12:03.786076 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:12:03.786076 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:03.786076 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:12:03.786076 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:12:03.786076 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:12:03.786076 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:12:03.786076 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 could not be found. Aug 24 08:12:03.786076 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:12:03.787459 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-741288bd-7718-4c4f-9056-4d0a367c7513 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Returning 404 to user: Instance f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:12:03.787459 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-741288bd-7718-4c4f-9056-4d0a367c7513 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0" status: 404 len: 111 microversion: 2.1 time: 0.032659 Aug 24 08:12:03.787459 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 565/1127] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:12:03 2022] GET /compute/v2.1/servers/f2c8ff2f-60ca-48f1-8f05-07bd70a0ebb0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:12:05.080830 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-af883215-b68d-40f9-94eb-4c9c0c5f9bc2 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:12:05.081317 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.compute.api [None req-af883215-b68d-40f9-94eb-4c9c0c5f9bc2 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: ab2c4538-253e-44ea-8fb9-e392f59cb6f1] Fetching instance by UUID {{(pid=127590) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:12:05.088224 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-af883215-b68d-40f9-94eb-4c9c0c5f9bc2 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:12:05.088730 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-af883215-b68d-40f9-94eb-4c9c0c5f9bc2 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:12:05.089168 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-af883215-b68d-40f9-94eb-4c9c0c5f9bc2 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:12:05.089860 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-af883215-b68d-40f9-94eb-4c9c0c5f9bc2 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:12:05.090307 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-af883215-b68d-40f9-94eb-4c9c0c5f9bc2 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:12:05.090730 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG oslo_concurrency.lockutils [None req-af883215-b68d-40f9-94eb-4c9c0c5f9bc2 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:12:05.103838 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.wsgi [None req-af883215-b68d-40f9-94eb-4c9c0c5f9bc2 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] HTTP exception thrown: Instance ab2c4538-253e-44ea-8fb9-e392f59cb6f1 could not be found. Aug 24 08:12:05.105384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-af883215-b68d-40f9-94eb-4c9c0c5f9bc2 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Request method failure captured: Aug 24 08:12:05.105384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: request: DELETE /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1 HTTP/1.1 Aug 24 08:12:05.105384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept: application/json Aug 24 08:12:05.105384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Accept-Encoding: identity Aug 24 08:12:05.105384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Connection: close Aug 24 08:12:05.105384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Length: 0 Aug 24 08:12:05.105384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Content-Type: application/json Aug 24 08:12:05.105384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Host: 10.222.0.72 Aug 24 08:12:05.105384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Openstack-System-Scope: None Aug 24 08:12:05.105384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: User-Agent: python-urllib3/1.26.11 Aug 24 08:12:05.105384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Auth-Token: gAAAAABjBdxHOPiPdOZ5uR2SSeO0emctlMLk69rDmbU_apNTseI1EhtGeRqNZVBzCd4zNjmRItzEaz1cDmbEIedCWI4-AP-FzBdtrm_-Z6ZW1yFhxP0pSPtWg21hOmERjLzpQbEdNfRSjetqsS5m07LbvxlL6162IOZUIpN1pT6nBdD4o63LH-Q Aug 24 08:12:05.105384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Id: None Aug 24 08:12:05.105384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Domain-Name: None Aug 24 08:12:05.105384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Identity-Status: Confirmed Aug 24 08:12:05.105384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Is-Admin-Project: True Aug 24 08:12:05.105384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Id: default Aug 24 08:12:05.105384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Domain-Name: Default Aug 24 08:12:05.105384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Id: 2d92c8aa6d4d46538574779ae23ac398 Aug 24 08:12:05.105384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Project-Name: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:12:05.105384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Role: reader,member Aug 24 08:12:05.105384 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Roles: reader,member Aug 24 08:12:05.107126 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d92c8aa6d4d46538574779ae23ac398"}]}] Aug 24 08:12:05.107126 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:12:05.107126 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Id: 2d92c8aa6d4d46538574779ae23ac398 Aug 24 08:12:05.107126 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:12:05.107126 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User: tempest-AttachVolumeNegativeTest-1826831321-project Aug 24 08:12:05.107126 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Id: default Aug 24 08:12:05.107126 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Domain-Name: Default Aug 24 08:12:05.107126 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Id: 5344a1d76e764da9b08f4cb7a2bd8ca5 Aug 24 08:12:05.107126 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: X-User-Name: tempest-AttachVolumeNegativeTest-1826831321-project Aug 24 08:12:05.107126 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: method: > Aug 24 08:12:05.107126 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: exception: Instance ab2c4538-253e-44ea-8fb9-e392f59cb6f1 could not be found. Aug 24 08:12:05.107126 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: action_args: {'id': 'ab2c4538-253e-44ea-8fb9-e392f59cb6f1'} Aug 24 08:12:05.108079 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:12:05.108079 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:05.108079 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:12:05.108079 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:12:05.108079 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:12:05.108079 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:12:05.108079 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:12:05.108079 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:12:05.108079 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:12:05.108079 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:12:05.108079 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab2c4538-253e-44ea-8fb9-e392f59cb6f1 could not be found. Aug 24 08:12:05.108079 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:12:05.108079 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:12:05.108079 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:12:05.108079 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:05.108079 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:12:05.108079 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:12:05.108079 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:12:05.108079 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:12:05.108079 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:12:05.109708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:12:05.109708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 08:12:05.109708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 08:12:05.109708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 08:12:05.109708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 08:12:05.109708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:12:05.109708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:12:05.109708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:12:05.109708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:12:05.109708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab2c4538-253e-44ea-8fb9-e392f59cb6f1 could not be found. Aug 24 08:12:05.109708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:12:05.109708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:12:05.109708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:12:05.109708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:05.109708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:12:05.109708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:12:05.109708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:12:05.109708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:12:05.109708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab2c4538-253e-44ea-8fb9-e392f59cb6f1 could not be found. Aug 24 08:12:05.109708 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: ERROR nova.api.openstack.wsgi Aug 24 08:12:05.111358 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-af883215-b68d-40f9-94eb-4c9c0c5f9bc2 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Returning 404 to user: Instance ab2c4538-253e-44ea-8fb9-e392f59cb6f1 could not be found. {{(pid=127590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:12:05.111358 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-af883215-b68d-40f9-94eb-4c9c0c5f9bc2 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "DELETE /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1" status: 404 len: 111 microversion: 2.1 time: 0.029784 Aug 24 08:12:05.111358 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 563/1128] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 24 08:12:05 2022] DELETE /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:12:05.115529 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-f88229f0-e711-4c82-9998-9fa153411e10 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Calling method '>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:12:05.116164 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.compute.api [None req-f88229f0-e711-4c82-9998-9fa153411e10 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] [instance: ab2c4538-253e-44ea-8fb9-e392f59cb6f1] Fetching instance by UUID {{(pid=127589) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:12:05.122725 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f88229f0-e711-4c82-9998-9fa153411e10 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:12:05.123209 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f88229f0-e711-4c82-9998-9fa153411e10 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:12:05.123678 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f88229f0-e711-4c82-9998-9fa153411e10 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:12:05.124446 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f88229f0-e711-4c82-9998-9fa153411e10 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Acquiring lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:12:05.124932 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f88229f0-e711-4c82-9998-9fa153411e10 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:12:05.125368 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG oslo_concurrency.lockutils [None req-f88229f0-e711-4c82-9998-9fa153411e10 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Lock "bfac71ef-5ab0-4896-a5e4-5bd5fe410926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:12:05.139392 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.wsgi [None req-f88229f0-e711-4c82-9998-9fa153411e10 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] HTTP exception thrown: Instance ab2c4538-253e-44ea-8fb9-e392f59cb6f1 could not be found. Aug 24 08:12:05.141202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-f88229f0-e711-4c82-9998-9fa153411e10 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Request method failure captured: Aug 24 08:12:05.141202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: request: GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1 HTTP/1.1 Aug 24 08:12:05.141202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept: application/json Aug 24 08:12:05.141202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Accept-Encoding: identity Aug 24 08:12:05.141202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Connection: close Aug 24 08:12:05.141202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Length: 0 Aug 24 08:12:05.141202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Content-Type: application/json Aug 24 08:12:05.141202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Host: 10.222.0.72 Aug 24 08:12:05.141202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Openstack-System-Scope: None Aug 24 08:12:05.141202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: User-Agent: python-urllib3/1.26.11 Aug 24 08:12:05.141202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Auth-Token: gAAAAABjBdxHOPiPdOZ5uR2SSeO0emctlMLk69rDmbU_apNTseI1EhtGeRqNZVBzCd4zNjmRItzEaz1cDmbEIedCWI4-AP-FzBdtrm_-Z6ZW1yFhxP0pSPtWg21hOmERjLzpQbEdNfRSjetqsS5m07LbvxlL6162IOZUIpN1pT6nBdD4o63LH-Q Aug 24 08:12:05.141202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Id: None Aug 24 08:12:05.141202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Domain-Name: None Aug 24 08:12:05.141202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Identity-Status: Confirmed Aug 24 08:12:05.141202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Is-Admin-Project: True Aug 24 08:12:05.141202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Id: default Aug 24 08:12:05.141202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Domain-Name: Default Aug 24 08:12:05.141202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Id: 2d92c8aa6d4d46538574779ae23ac398 Aug 24 08:12:05.141202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Project-Name: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:12:05.141202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Role: reader,member Aug 24 08:12:05.141202 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Roles: reader,member Aug 24 08:12:05.142967 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d92c8aa6d4d46538574779ae23ac398"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d92c8aa6d4d46538574779ae23ac398"}]}] Aug 24 08:12:05.142967 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:12:05.142967 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Id: 2d92c8aa6d4d46538574779ae23ac398 Aug 24 08:12:05.142967 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1826831321 Aug 24 08:12:05.142967 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User: tempest-AttachVolumeNegativeTest-1826831321-project Aug 24 08:12:05.142967 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Id: default Aug 24 08:12:05.142967 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Domain-Name: Default Aug 24 08:12:05.142967 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Id: 5344a1d76e764da9b08f4cb7a2bd8ca5 Aug 24 08:12:05.142967 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: X-User-Name: tempest-AttachVolumeNegativeTest-1826831321-project Aug 24 08:12:05.142967 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: method: > Aug 24 08:12:05.142967 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: exception: Instance ab2c4538-253e-44ea-8fb9-e392f59cb6f1 could not be found. Aug 24 08:12:05.142967 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: action_args: {'id': 'ab2c4538-253e-44ea-8fb9-e392f59cb6f1'} Aug 24 08:12:05.143956 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:12:05.143956 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:05.143956 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:12:05.143956 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:12:05.143956 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:12:05.143956 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:12:05.143956 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:12:05.143956 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:12:05.143956 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:12:05.143956 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:12:05.143956 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab2c4538-253e-44ea-8fb9-e392f59cb6f1 could not be found. Aug 24 08:12:05.143956 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:12:05.143956 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:12:05.143956 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:12:05.143956 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:05.143956 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:12:05.143956 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:12:05.143956 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:12:05.143956 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:12:05.143956 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:12:05.145574 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:12:05.145574 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:12:05.145574 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:12:05.145574 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:12:05.145574 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:12:05.145574 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:12:05.145574 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:12:05.145574 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab2c4538-253e-44ea-8fb9-e392f59cb6f1 could not be found. Aug 24 08:12:05.145574 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:12:05.145574 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:12:05.145574 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:12:05.145574 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:12:05.145574 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:12:05.145574 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:12:05.145574 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:12:05.145574 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:12:05.145574 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab2c4538-253e-44ea-8fb9-e392f59cb6f1 could not be found. Aug 24 08:12:05.145574 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: ERROR nova.api.openstack.wsgi Aug 24 08:12:05.150105 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-f88229f0-e711-4c82-9998-9fa153411e10 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] Returning 404 to user: Instance ab2c4538-253e-44ea-8fb9-e392f59cb6f1 could not be found. {{(pid=127589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:12:05.150105 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-f88229f0-e711-4c82-9998-9fa153411e10 tempest-AttachVolumeNegativeTest-1826831321 tempest-AttachVolumeNegativeTest-1826831321-project] 10.222.0.72 "GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1" status: 404 len: 111 microversion: 2.1 time: 0.031089 Aug 24 08:12:05.150105 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 566/1129] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 24 08:12:05 2022] GET /compute/v2.1/servers/ab2c4538-253e-44ea-8fb9-e392f59cb6f1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:12:12.434659 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-00d7ff88-5ca1-42d2-99e6-afc27ae253be tempest-VolumesTestJSON-1101626126 tempest-VolumesTestJSON-1101626126-project] Calling method '.version_select at 0x7f320c281ca0>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:12:12.481287 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-00d7ff88-5ca1-42d2-99e6-afc27ae253be tempest-VolumesTestJSON-1101626126 tempest-VolumesTestJSON-1101626126-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/674e919c-a065-40b9-9537-64a22a91f2ef" status: 200 len: 351 microversion: 2.1 time: 0.050355 Aug 24 08:12:12.481842 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 564/1130] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 24 08:12:12 2022] GET /compute/v2.1/os-volumes/674e919c-a065-40b9-9537-64a22a91f2ef => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:12:14.152425 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-bebd97a2-c143-46ba-b141-25e66e323396 tempest-VolumesTestJSON-1101626126 tempest-VolumesTestJSON-1101626126-project] Calling method '.version_select at 0x7f320cb0b1f0>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:12:14.206476 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-bebd97a2-c143-46ba-b141-25e66e323396 tempest-VolumesTestJSON-1101626126 tempest-VolumesTestJSON-1101626126-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/63d68039-6235-4fb7-b2a1-8e721e2f78d7" status: 200 len: 351 microversion: 2.1 time: 0.058018 Aug 24 08:12:14.207158 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 567/1131] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 24 08:12:14 2022] GET /compute/v2.1/os-volumes/63d68039-6235-4fb7-b2a1-8e721e2f78d7 => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:12:15.799421 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:12:15.800207 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG dbcounter [-] [127590] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:12:15.804053 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-4122fd59-1ff0-45cb-82dc-b58b5f63b2d1 tempest-VolumesTestJSON-1101626126 tempest-VolumesTestJSON-1101626126-project] Calling method '.version_select at 0x7f3210aee430>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:12:15.855408 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-4122fd59-1ff0-45cb-82dc-b58b5f63b2d1 tempest-VolumesTestJSON-1101626126 tempest-VolumesTestJSON-1101626126-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/0d9316c0-c19a-4828-bbda-d63f9864a49d" status: 200 len: 351 microversion: 2.1 time: 0.057168 Aug 24 08:12:15.855968 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 565/1132] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 24 08:12:15 2022] GET /compute/v2.1/os-volumes/0d9316c0-c19a-4828-bbda-d63f9864a49d => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:12:15.866293 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:12:15.867061 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG dbcounter [-] [127589] Writing DB stats nova_cell1:SELECT=39,nova_cell1:INSERT=1 {{(pid=127589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:12:15.871306 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-42c803cc-c924-4278-8420-c4ea467955e8 tempest-VolumesTestJSON-1101626126 tempest-VolumesTestJSON-1101626126-project] Calling method '.version_select at 0x7f320c029ee0>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:12:15.954566 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-42c803cc-c924-4278-8420-c4ea467955e8 tempest-VolumesTestJSON-1101626126 tempest-VolumesTestJSON-1101626126-project] 10.222.0.72 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.089674 Aug 24 08:12:15.955140 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 568/1133] 10.222.0.72 () {58 vars in 1134 bytes} [Wed Aug 24 08:12:15 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:12:15.969211 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-db8fc3ce-763b-460e-934e-5f188d3cf6f3 tempest-VolumesTestJSON-1101626126 tempest-VolumesTestJSON-1101626126-project] Calling method '.version_select at 0x7f320c2bde50>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:12:16.050670 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-db8fc3ce-763b-460e-934e-5f188d3cf6f3 tempest-VolumesTestJSON-1101626126 tempest-VolumesTestJSON-1101626126-project] 10.222.0.72 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085827 Aug 24 08:12:16.051236 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 566/1134] 10.222.0.72 () {58 vars in 1149 bytes} [Wed Aug 24 08:12:15 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:12:16.064806 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-ea89a866-0e1d-417f-9da4-e73360834c4c tempest-VolumesTestJSON-1101626126 tempest-VolumesTestJSON-1101626126-project] Calling method '.version_select at 0x7f320cb58280>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:12:16.146934 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-ea89a866-0e1d-417f-9da4-e73360834c4c tempest-VolumesTestJSON-1101626126 tempest-VolumesTestJSON-1101626126-project] 10.222.0.72 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.085888 Aug 24 08:12:16.147497 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 569/1135] 10.222.0.72 () {58 vars in 1134 bytes} [Wed Aug 24 08:12:16 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:12:16.162805 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-fb64c4e5-c83b-4137-8369-049059963a43 tempest-VolumesTestJSON-1101626126 tempest-VolumesTestJSON-1101626126-project] Calling method '.version_select at 0x7f3210aee670>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:12:16.243835 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-fb64c4e5-c83b-4137-8369-049059963a43 tempest-VolumesTestJSON-1101626126 tempest-VolumesTestJSON-1101626126-project] 10.222.0.72 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084780 Aug 24 08:12:16.244401 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 567/1136] 10.222.0.72 () {58 vars in 1167 bytes} [Wed Aug 24 08:12:16 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:12:16.257283 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-85da8ab0-8be7-499c-a741-bf2bf4b2027d tempest-VolumesTestJSON-1101626126 tempest-VolumesTestJSON-1101626126-project] Calling method '.version_select at 0x7f320cdc6f70>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:12:16.341614 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-85da8ab0-8be7-499c-a741-bf2bf4b2027d tempest-VolumesTestJSON-1101626126 tempest-VolumesTestJSON-1101626126-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.088027 Aug 24 08:12:16.342761 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 570/1137] 10.222.0.72 () {58 vars in 1170 bytes} [Wed Aug 24 08:12:16 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:12:16.355981 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-1ff0474a-27c1-47e7-b7f6-7835f36586f0 tempest-VolumesTestJSON-1101626126 tempest-VolumesTestJSON-1101626126-project] Calling method '.version_select at 0x7f3210afd940>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:12:16.438749 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-1ff0474a-27c1-47e7-b7f6-7835f36586f0 tempest-VolumesTestJSON-1101626126 tempest-VolumesTestJSON-1101626126-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.086437 Aug 24 08:12:16.439314 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 568/1138] 10.222.0.72 () {58 vars in 1155 bytes} [Wed Aug 24 08:12:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:12:16.452051 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: DEBUG nova.api.openstack.wsgi [None req-049859ff-c728-4667-a796-2f1dbd10ddda tempest-VolumesTestJSON-1101626126 tempest-VolumesTestJSON-1101626126-project] Calling method '.version_select at 0x7f320ce0a5e0>' {{(pid=127589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:12:16.537772 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO nova.api.openstack.requestlog [None req-049859ff-c728-4667-a796-2f1dbd10ddda tempest-VolumesTestJSON-1101626126 tempest-VolumesTestJSON-1101626126-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084412 Aug 24 08:12:16.537772 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: [pid: 127589|app: 0|req: 571/1139] 10.222.0.72 () {58 vars in 1188 bytes} [Wed Aug 24 08:12:16 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:12:16.549678 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: DEBUG nova.api.openstack.wsgi [None req-a0078670-431a-4afd-8802-2fced34a7ff2 tempest-VolumesTestJSON-1101626126 tempest-VolumesTestJSON-1101626126-project] Calling method '.version_select at 0x7f3210afdb80>' {{(pid=127590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:12:16.633516 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO nova.api.openstack.requestlog [None req-a0078670-431a-4afd-8802-2fced34a7ff2 tempest-VolumesTestJSON-1101626126 tempest-VolumesTestJSON-1101626126-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.085842 Aug 24 08:12:16.633516 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: [pid: 127590|app: 0|req: 569/1140] 10.222.0.72 () {58 vars in 1155 bytes} [Wed Aug 24 08:12:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:13:55.859665 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:13:55.860385 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Wed Aug 24 08:13:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:14:03.495842 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:14:03.496438 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Wed Aug 24 08:14:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:14:16.659313 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:14:16.659910 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Wed Aug 24 08:14:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:14:19.515670 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:14:19.516239 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Wed Aug 24 08:14:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:15:43.377025 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:15:43.377934 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Wed Aug 24 08:15:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:17:15.869497 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:17:15.870092 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Wed Aug 24 08:17:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:17:23.504717 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:17:23.505302 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Wed Aug 24 08:17:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:17:36.669136 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:17:36.669720 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Wed Aug 24 08:17:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:17:37.379283 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:17:37.379518 dv-cinder-854275-1-iscsi devstack@n-api.service[127589]: Wed Aug 24 08:17:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:17:39.524503 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:17:39.525036 dv-cinder-854275-1-iscsi devstack@n-api.service[127590]: Wed Aug 24 08:17:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!